AWS Data Engineer

3 weeks ago

India Inityinfotech Full time

Job Description AWS Data Engineer Experience :- 5+ years Location : Remote Job Description Design, development, and implementation of performant ETL pipelines using python API (pySpark) of Apache Spark on AWS EMR. Writing reusable, testable, and efficient code Integration of data storage solutions in spark especially with AWS S3 object storage. Performance tuning of pySpark scripts. Need to ensure overall build delivery quality is good and on-time delivery is done at all times. Should be able to handle meetings with customers with ease. Need to have excellent communication skills to interact with the customer. Be a team player and willing to work in an onsite-offshore model, mentor other folks in the team (onsite as well as offshore) *5+ years of experience in programming with python. Strong proficiency in python *Familiarity with functional programming concepts *3+ years of hands-on experience in developing ETL data pipelines using pySpark on AWS EMR *Experience in building pipelines and data lake for large enterprises on AWS *Good understanding of Spark's Dataframe and API *Experience in configuring EMR clusters on AWS *Experience in dealing with AWS S3 object storage from Spark. *Experience in troubleshooting spark jobs. Knowledge of monitoring spark jobs using Spark UI *Performance tuning of Spark jobs. *Understanding fundamental design principles behind business processes Process Knowledge and Expertise: Demonstrated experience in change management processes, including understanding of governance frameworks and preparation of supporting artefacts required for approvals. Strong clarity on the path to production, with hands-on involvement in deployments, testing cycles, and obtaining business sign-offs. Proven track record in technical solution design, with the ability to provide architectural guidance and support implementation strategies. Databricks-Specific Skills: Experience in at least developing and delivering end-to-end Proof of Concept (POC) solutions covering the below: Basic proficiency in Databricks, including creating jobs and configuring clusters. Exposure to connecting external data sources (e.g., Amazon S3) to Databricks. Understanding of Unity Catalog and its role in data governance. Familiarity with notebook orchestration and implementing modular code structures to enhance scalability and maintainability.

  • AWS Data Engineer

    2 days ago

    India Zensar Technologies Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    DescriptionAWS Data Engineer - GCH must have:Proficiency with Matillion ETL: Using the Matillion ETL platform for data integration.Cloud Data Warehouses: Familiarity with cloud data warehouses like Snowflake, AWS Redshift, or Google BigQuery.Key Responsibilities:Design & Develop Data Pipelines: Build and optimize scalable, reliable, and automated ETL/ELT...

  • Data Engineer

    3 days ago

    India Crayon Data Full time ₹ 5,00,000 - ₹ 15,00,000 per year

    Job DescriptionData Engineer – ChennaiBuild the foundation of data intelligence — design, develop, and optimize data pipelines that power AI-driven insights.Location: Chennai, IndiaExperience: 2–3 years in data engineering or data-driven product developmentRole OverviewAs a Data Engineer, you will be responsible for building and maintaining scalable...

  • AWS Data Engineer

    2 weeks ago

    Hyderabad, India Coforge Full time

    Job Description We're Hiring: AWS Data Engineers at Coforge Ltd. Immediate Joiners Preferred. Job Locations: Hyderabad & Greater Noida Experience Required: 5 to 7 Years Send your CV to [Confidential Information] About the Role: As an AWS Data Engineer, you will be responsible for designing, developing, and optimizing robust, scalable, and secure data...

  • AWS Data Engineer

    1 week ago

    Bengaluru, India Deloitte Full time

    Job Description Dear Candidate, Looking for Skilled AWS Data Engineer, Interested candidates please find the JD below: Bachelor's Degree and 3+ years experience in the implementation of modern data ecosystems in AWS/Cloud platforms. 3+ years experience in Python, SQL. 3+ years experience in Lambda 3+ years experience in Glue 3+ years experience in Redshift,...

  • Senior Data Scientist

    4 weeks ago

    Mumbai, India Amazon Web Services (AWS) Full time

    Job Description Description AWS Sales, Marketing, and Global Services (SMGS) is responsible for driving revenue, adoption, and growth from the largest and fastest growing small- and mid-market accounts to enterprise-level customers including public sector. AWS Global Services includes experts from across AWS who help our customers design, build, operate, and...

  • AWS Data Engineer

    2 weeks ago

    Bengaluru, India Coforge Full time

    Job Description AWS Data Engineer Job Location: Bengaluru Experience Required: 5+ Years Mandatory Skills: AWS Services, ETL, ETL Integration, CodePipeline, Jenkins, Glue, EMR, Athena, ECS, EKS, Kubernetes, CloudWatch, Prometheus, Grafana, Python, Shell, or PowerShell Job Description: We are looking for an experienced AWS Engineer with around 5-8 years of...

  • Sr. AWS Data Engineer

    1 day ago

    India ProArch Full time US$ 60,000 - US$ 1,20,000 per year

    ProArch is seeking a highly skilled Sr. AWS Data Engineer to join our growing team. In this role, you will leverage your expertise in AWS to design, implement, and manage robust data solutions that enable our organization to capture, store, and analyze vast amounts of data. You will work closely with data scientists, analysts, and other engineering teams to...

  • AWS Data Engineer

    2 weeks ago

    India TerraGiG Full time

    Role AWS Data Engineer Experience 8+ years Location Remote Time Zone UK Duration 2 months (Extendable) Job Description Design, development, and implementation of performant ETL pipelines using python API (pySpark) of Apache Spark on AWS EMR. Writing reusable, testable, and efficient code Integration of data storage solutions in spark – especially with AWS...

  • AWS Data Engineer

    2 weeks ago

    India TerraGiG Full time

    Role AWS Data Engineer Experience 8+ years Location Remote Time Zone UK Duration 2 months (Extendable) Job Description Design, development, and implementation of performant ETL pipelines using python API (pySpark) of Apache Spark on AWS EMR. Writing reusable, testable, and efficient code Integration of data storage solutions in spark – especially with AWS...

  • Senior AWS Data Engineer

    3 weeks ago

    India CYAN360 Full time

    Position: Senior AWS Data Engineer Location: Remote Salary: Open Work Timings: 2:30 PM to 11:30 PM IST *** Need someone who can join immediately or in 15 days*** Responsibilities: Design, develop, and deploy end-to-end data pipelines on AWS cloud infrastructure using services such as Amazon S3, AWS Glue, AWS Lambda, Amazon Redshift, etc. Implement data...