AWS Data Engineer

1 day ago

India Inityinfotech Full time

Job Description AWS Data Engineer Experience :- 5+ years Location : Remote Job Description Design, development, and implementation of performant ETL pipelines using python API (pySpark) of Apache Spark on AWS EMR. Writing reusable, testable, and efficient code Integration of data storage solutions in spark especially with AWS S3 object storage. Performance tuning of pySpark scripts. Need to ensure overall build delivery quality is good and on-time delivery is done at all times. Should be able to handle meetings with customers with ease. Need to have excellent communication skills to interact with the customer. Be a team player and willing to work in an onsite-offshore model, mentor other folks in the team (onsite as well as offshore) *5+ years of experience in programming with python. Strong proficiency in python *Familiarity with functional programming concepts *3+ years of hands-on experience in developing ETL data pipelines using pySpark on AWS EMR *Experience in building pipelines and data lake for large enterprises on AWS *Good understanding of Spark's Dataframe and API *Experience in configuring EMR clusters on AWS *Experience in dealing with AWS S3 object storage from Spark. *Experience in troubleshooting spark jobs. Knowledge of monitoring spark jobs using Spark UI *Performance tuning of Spark jobs. *Understanding fundamental design principles behind business processes Process Knowledge and Expertise: Demonstrated experience in change management processes, including understanding of governance frameworks and preparation of supporting artefacts required for approvals. Strong clarity on the path to production, with hands-on involvement in deployments, testing cycles, and obtaining business sign-offs. Proven track record in technical solution design, with the ability to provide architectural guidance and support implementation strategies. Databricks-Specific Skills: Experience in at least developing and delivering end-to-end Proof of Concept (POC) solutions covering the below: Basic proficiency in Databricks, including creating jobs and configuring clusters. Exposure to connecting external data sources (e.g., Amazon S3) to Databricks. Understanding of Unity Catalog and its role in data governance. Familiarity with notebook orchestration and implementing modular code structures to enhance scalability and maintainability.

  • Aws Data Engineer

    4 weeks ago

    India Adastra Corp Full time

    As an AWS Data Engineer, you will be responsible for: Technical requirements gathering and development of functional specificationsCommunicating with technical contacts regarding incoming and outgoing data interfacesImplementing the data pipelinesDevelop and implement best practices for AWS applications: Data Integration, Analytics & ReportingCreate ETL jobs...

  • Senior Data Scientist

    3 days ago

    Mumbai, India Amazon Web Services (AWS) Full time

    Job Description Description AWS Sales, Marketing, and Global Services (SMGS) is responsible for driving revenue, adoption, and growth from the largest and fastest growing small- and mid-market accounts to enterprise-level customers including public sector. AWS Global Services includes experts from across AWS who help our customers design, build, operate, and...

  • AWS Data Engineer

    3 weeks ago

    Chennai, India Crescent Techservices Full time

    Job Description Role: AWS Data Engineer Type: 6-12 month contract Location: Chennai, Tamil Nadu (WFO) Experience: 6-8 Years Requirements: - Proficiency in Python and PySpark: Strong experience writing robust Python code and utilizing PySpark for distributed data processing, transformation, and working with large datasets. - AWS Data Engineering...

  • Data Engineer

    7 days ago

    Delhi, India Weekday (YC W21) Full time

    Job Description This role is for one of our clients Company Name: Muoro.io Industry: Technology, Information and Media Seniority level: Mid-Senior level Min Experience: 5 years Location: NCR JobType: full-time We are seeking an experienced Data Engineer with deep expertise in the AWS data ecosystem to design, build, and optimize scalable data pipelines and...

  • AWS Data Engineer

    2 weeks ago

    india Tata Consultancy Services Full time

    Dear CandidateGreetings from TATA Consultancy Services Job Openings at TCS Skill: AWS Data Engineer Exp range:6 yrs to 10 yrs location : Bangalore Notice period– 30 – 45 daysPls find the Job Description below. Hands-on experience in Pyspark, Glue Experience on EMR, S3, IAM, Lambda, Cloud formation, Python AMI Rehydration, Python, ELB and other AWS...

  • AWS Data Engineer

    1 week ago

    Bengaluru, Karnataka, India, Karnataka L&T Technology Services Full time

    AWS Data Engineer:Exp: 8-10 yrsLocation: BangaloreSkills:1) Graduate with 8-10 years of experience working as a AWS Data Engineer2) Excellent knowledge of PySpark, JavaScript, AWS - RDS, and Redshift

  • AWS Data Engineer

    2 weeks ago

    india Tata Consultancy Services Full time

    Dear CandidateGreetings from TATA Consultancy ServicesJob Openings at TCSSkill: AWS Data EngineerExp range: 6 yrs to 10 yrslocation: BangaloreNotice period – 30 – 45 daysPls find the Job Description below.- Hands-on experience in Pyspark, Glue - Experience on EMR, S3, IAM, Lambda, Cloud formation, Python - AMI Rehydration, Python, ELB and other AWS...

  • Data engineer

    2 weeks ago

    India Data-Hat AI Full time

    Department: Data Engineering & AI Solutions  Reports To: Lead Data Solutions Architect  Travel: International travel required (up to 30–40%)   Position Summary:   We are hiring a senior-level Data Engineer to lead the design, development, and optimization of high-performance data infrastructure that underpins mission-critical AI systems. With 12+...

  • Senior AWS Data Engineer

    1 day ago

    India CYAN360 Full time

    Position: Senior AWS Data Engineer Location: Remote Salary: Open Work Timings: 2:30 PM to 11:30 PM IST *** Need someone who can join immediately or in 15 days*** Responsibilities: Design, develop, and deploy end-to-end data pipelines on AWS cloud infrastructure using services such as Amazon S3, AWS Glue, AWS Lambda, Amazon Redshift, etc. Implement data...

  • Lead AWS Data Engineer

    7 days ago

    Hyderabad, India Coforge Full time

    Job Description Job Title: Lead AWS Data Engineer Skills: Big Data technologies (e.g., Hadoop, Spark) and AWS S3. Python or Java or Scala. data modeling, ETL processes, and data warehousing solutions Experience Required: 8 - 12 Years Job Location: Hyderabad, Pune & Greater Noida We at Coforge are hiring Lead AWS Data Engineer with following skillset: - As a...