Skip to main content

Posts

Simple meaning aws glue default libraries : spark/pyspark/python

import sys To get sys.argv[] list argument pass to the python.without sys library getResolvedOptions method will not work.That is  "getResolvedOptions(sys.argv, ['JOB_NAME'])" from awsglue.transforms import * With the import of awsglue.trnaformation , we can use all the glue managed data transformation classes on the dataframe. from awsglue.utils import getResolvedOptions awsglue.utils is responsible to read the parameters of the job. from pyspark.context import SparkContext It is an entry point to the pyspark functionality. from awsglue.context import GlueContext With awsglue.context, glue will interact with the spark-context. from awsglue.job import Job It will initialise the job and commit the job.
Recent posts

Gen AI applications for beginners and entrepreneurs.

Text Generation Content Creation : Writing articles, blogs, essays, and other long-form content. Creative Writing : Generating stories, poetry, scripts, and literature. Social Media Posts : Crafting posts, comments, and responses for social media platforms. Product Descriptions : Creating engaging and persuasive product descriptions for e-commerce. Conversational Agents Chatbots : Providing customer service, technical support, and information through conversational interfaces. Virtual Assistants : Assisting with scheduling, reminders, and answering queries (e.g., Siri, Alexa). Therapeutic Bots : Offering mental health support and therapy through conversations. Translation and Localization Language Translation : Translating text from one language to another. Localization : Adapting content to different cultures and regions, including idiomatic expressions and cultural nuances. Summarization and Information Extraction Text Summarization : Condensing long documents into concise summaries....

Programming languages for server less architectures.

Several programming languages are popular for serverless architecture, each offering unique advantages for different use cases. Here are the top programming languages widely used in serverless environments: JavaScript/Node.js : A dominant choice in serverless computing, particularly with AWS Lambda, Google Cloud Functions, and Azure Functions. Its asynchronous nature and large ecosystem of libraries make it ideal for developing scalable, event-driven applications  Python : Known for its simplicity and readability, Python is extensively used in serverless applications, especially for data processing, automation, and machine learning tasks. AWS Lambda, Azure Functions, and Google Cloud Functions all support Python. Frameworks like Chalice and Zappa facilitate the development and deployment of Python applications in serverless environments  Java : Favored for enterprise applications due to its performance and robustness. AWS Lambda and Azure Functions support Java, making it suit...

Overview of all Google Pixel phones up to the latest model as of 2023, including their specifications, pros, and cons.

  Google Pixel (2016) Specifications : Display : 5.0-inch AMOLED, 1080 x 1920 pixels Processor : Qualcomm Snapdragon 821 RAM : 4 GB Storage : 32/128 GB Camera : 12.3 MP rear, 8 MP front Battery : 2770 mAh OS : Android 7.1 (Nougat), upgradable Pros : Excellent camera, pure Android experience, Google Assistant Cons : Expensive, no water resistance, limited availability Google Pixel XL (2016) Specifications : Display : 5.5-inch AMOLED, 1440 x 2560 pixels Processor : Qualcomm Snapdragon 821 RAM : 4 GB Storage : 32/128 GB Camera : 12.3 MP rear, 8 MP front Battery : 3450 mAh OS : Android 7.1 (Nougat), upgradable Pros : Excellent camera, larger display, pure Android experience Cons : Expensive, no water resistance, design not innovative Google Pixel 2 (2017) Specifications : Display : 5.0-inch AMOLED, 1080 x 1920 pixels Processor : Qualcomm Snapdragon 835 RAM : 4 GB Storage : 64/128 GB Camera : 12.2 MP rear, 8 MP front Battery : 2700 mAh OS : Android 8.0 (Oreo), upgradable Pros : Excellen...

Comprehensive overview of the major iPhone versions up to the latest model as of 2023.may not cover every single variant (like the iPhone SE or the Plus/Pro Max versions in great detail), but I'll provide a general view of each generation.

  iPhone 2G (2007) Specifications : 3.5-inch screen 2 MP camera No video recording No App Store support initially 4, 8, 16 GB storage options Pros : Revolutionary touchscreen, internet communication device, music player Cons : No 3G, no video recording, no third-party apps initially iPhone 3G (2008) Specifications : 3.5-inch screen 2 MP camera 3G connectivity App Store introduced 8, 16 GB storage options Pros : 3G support, App Store, GPS Cons : Still no video recording, no front camera iPhone 3GS (2009) Specifications : 3.5-inch screen 3 MP camera with video recording Faster performance 8, 16, 32 GB storage options Pros : Faster processor, video recording, better camera Cons : Design unchanged, still no front camera iPhone 4 (2010) Specifications : 3.5-inch Retina display 5 MP rear camera, VGA front camera A4 processor Glass and stainless steel design 8, 16, 32 GB storage options Pros : Retina display, better cameras, new design Cons : Antenna issues ("Antennagate"), fragile ...