Aws data engineer

3 weeks ago

Mysuru, India TerraGiG Full time

RoleAWS Data EngineerExperience8+ yearsLocationRemoteTime ZoneUKDuration2 months (Extendable)Job DescriptionDesign, development, and implementation of performant ETL pipelines using python API (py Spark) of Apache Spark on AWS EMR.Writing reusable, testable, and efficient codeIntegration of data storage solutions in spark – especially with AWS S3 object storage. Performance tuning of py Spark scripts.Need to ensure overall build delivery quality is good and on-time delivery is done at all times.Should be able to handle meetings with customers with ease.Need to have excellent communication skills to interact with the customer.Be a team player and willing to work in an onsite-offshore model, mentor other folks in the team (onsite as well as offshore) *5+ years of experience in programming with python. Strong proficiency in python*Familiarity with functional programming concepts*3+ years of hands-on experience in developing ETL data pipelines using py Spark on AWS EMR*Experience in building pipelines and data lake for large enterprises on AWS*Good understanding of Spark’s Dataframe and API*Experience in configuring EMR clusters on AWS*Experience in dealing with AWS S3 object storage from Spark.*Experience in troubleshooting spark jobs. Knowledge of monitoring spark jobs using Spark UI*Performance tuning of Spark jobs.*Understanding fundamental design principles behind business processes Process Knowledge and Expertise:Demonstrated experience in change management processes, including understanding of governance frameworks and preparation of supporting artefacts required for approvals.Strong clarity on the path to production, with hands-on involvement in deployments, testing cycles, and obtaining business sign-offs.Proven track record in technical solution design, with the ability to provide architectural guidance and support implementation strategies. Databricks-Specific Skills:Experience in at least developing and delivering end-to-end Proof of Concept (POC) solutions covering the below:Basic proficiency in Databricks, including creating jobs and configuring clusters.Exposure to connecting external data sources (e.g., Amazon S3) to Databricks.Understanding of Unity Catalog and its role in data governance.Familiarity with notebook orchestration and implementing modular code structures to enhance scalability and maintainability. Important Pointers:Candidates must have actual hands-on work experience, not just home projects or academic exercises.Profiles should clearly state how much experience they have in each skill area, as this helps streamline the interview process.Candidates must know their CV/profile inside out, including all projects and responsibilities listed. Any ambiguity or lack of clarity on the candidate’s part can lead to immediate rejection, as we value accuracy and ownership.They should be able to confidently explain their past experience, challenges handled, and technical contributions.

  • Senior Data Engineer

    1 week ago

    Mysuru, India Saaki Argus and Averil Consulting Full time

    About the Client: One of the cloud and data analytics company that empowers businesses to unlock insights and drive innovation through modern data solutions. Role : Senior Data Engineer (AWS) Experience : 6 to 10 years Location : Chennai & Hyderabad Notice Period : Immediate Joiners / Max. 30 days / Serving Notice only Skillsets: 6 – 10 years of experience...

  • Data engineer – azure

    1 week ago

    Mysuru, India Yoda Tech Full time

    Job Description   We are seeking a skilled and motivated Data Engineer to join our team and help build scalable, secure, and efficient data pipelines and platforms. The ideal candidate will have 2 to 4 years of hands-on experience with modern data engineering tools and cloud platforms, particularly in Azure and AWS ecosystems.   Key Responsibilities  ...

  • Data engineer

    24 hours ago

    Mysuru, India Veraxion Full time

    We’re looking for a Data Engineer to design, build, and scale modern data platforms on AWS. You’ll work with Python, Spark, DBT, and AWS-native services in an Agile environment to deliver scalable, secure, and high-performance data solutions.What you’ll doDevelop and optimize ETL/ELT pipelines with Python, DBT, and AWS services (Data Ops Live).Build...

  • Data Engineer

    4 weeks ago

    Mysuru, India GEMRAJ TECHNOLOGIES LIMITED Full time

    Job Title: Data Engineer Location: RemotePosition: Full-timeExp- Must Have 8+ YearsPosition OverviewWe are currently seeking a Data Engineer to join our technology team. In this role, you will work on building data-driven products that sit atop cloud-based data infrastructure. The ideal candidate is passionate about technology, software design, data...

  • Data Engineer

    2 days ago

    Mysuru, India Sirius AI Full time

    Data Engineer Job Description About Sirius AI Sirius AI is a US headquartered AI Consulting services and products company with operations in India. Sirius AI focuses on Financial Services enterprises and solutions / services delivered across multiple geographies. We are an innovation-driven AI and data driven consulting services firm with a high focus on...

  • Video Streaming Engineer

    4 days ago

    Mysuru, India Platonix AG Full time

    Job Title: Video Streaming Engineer (AWS/OTT) Location: Remote Company: Platonix (www.Platonix.ch) Type: Permanent/Contract 🌟 About Platonix: Platonix is the world’s first soul-centric wellbeing OTT platform, launched in February 2025. By converging Spirituality, Mind, and Body with AI-driven personalization and rich interactivity, Platonix empowers...

  • Data Scientist

    2 days ago

    Mysuru, India Epergne Solutions Full time

    Job Title : Data Scientist Location : Mysore / Pune / Bangalore Experience : 6+ Years (Immediate Joiners Only) Qualification : BE / B.Tech / ME / M.Tech Job Description: We are seeking an experienced Data Scientist with a strong background in advanced analytics, machine learning, and deep learning for the automotive domain. The ideal candidate will be...

  • Senior Data Integration Engineer

    3 days ago

    Mysuru, India Indsafri Full time

    Job Role: Senior Data Integration EngineerExp Required: Atleast 6 Years of relevant work experience in Data Integration Engineer with (Salesforce, Databricks & MuleSoft)Job Location: Chennai - Onsite (Initially remote for first few months, ready to work in Chennai location from Jan 2026)Company Name: IndsafriNotice Period: Immediate to 30 daysSHOULD HAVE...

  • Data Architect

    1 week ago

    Mysuru, India CareerUS Solutions Full time

    Position Overview:The Data Architect is responsible for designing, implementing, and managing the data architecture of the organization. This includes ensuring that data is accurate, accessible, secure, and scalable across all systems. The role focuses on developing data models, database solutions, and integration frameworks that support business...

  • Engineering Manager

    4 weeks ago

    Mysuru, India Coinbase Full time

    Ready to be pushed beyond what you think you’re capable of?At Coinbase, our mission is to increase economic freedom in the world. It’s a massive, ambitious opportunity that demands the best of us, every day, as we build the emerging onchain platform — and with it, the future global financial system.To achieve our mission, we’re seeking a very...