Aws Data Engineer

4 days ago

Chennai Hyderabad, India Acesoft Labs Full time ₹ 6,00,000 - ₹ 18,00,000 per year

Sr. Data Engineer AWS Databricks / Data Tech Lead – AWS Databricks (10 Positions)

Location : Chennai / Hyd

Key Responsibilities

  • Data Pipeline Development: Design and implement robust ETL/ELT pipelines using Databricks, PySpark, and Delta Lake to process structured and unstructured data efficiently.
  • Manage job orchestration, scheduling, and workflow automation through Databricks Workflows or Airflow.
  • Performance Optimization: Tune and optimize Databricks clusters and notebooks for performance, scalability, and cost-efficiency.
  • Data Governance: Implement data governance and lineage using Unity Catalog and other platform-native features
  • Collaboration: Work closely with data scientists, analysts, and business stakeholders to understand data requirements and deliver solutions that meet business needs.
  • Cloud Integration: Leverage cloud platforms (AWS) to build and deploy data solutions, ensuring seamless integration with existing infrastructure.
  • Data Modeling: Develop and maintain data models that support analytics and machine learning workflows.
  • Automation & Monitoring: Implement automated testing, monitoring, and alerting mechanisms to ensure data pipeline reliability and data quality.
  • Documentation & Best Practices: Maintain comprehensive documentation of data workflows and adhere to best practices in coding, version control, and data governance.

Required Qualifications

  • Experience: 5+ years in data engineering, with hands-on experience using Databricks and Apache Spark.
  • Programming Skills: Proficiency in Python and SQL;
  • Cloud Platforms: Strong experience with cloud services such as AWS (e.g., S3, Glue, Redshift
  • Data Engineering Tools: Familiarity with tools like Airflow, Kafka, and dbt.
  • Data Modeling: Experience in designing data models for analytics and machine learning applications.
  • Collaboration: Proven ability to work in cross-functional teams and communicate effectively with non-technical stakeholders.

Primary Skill Set

Databricks, Apache Spark/Pyspark, Python, SQL, ETL/ELT development, Delta Lake, Cloud platforms (AWS), Data modeling, Cross-functional collaboration, Communication

Secondary Skill Set

Airflow, dbt, Kafka, Hadoop, MLflow, Unity Catalog, Delta Live Tables, Cluster optimization, Data governance, Security and compliance, Databricks certifications

Mail id or

  • AWS Data Engineer

    18 hours ago

    Chennai, Hyderabad, Kolkata, India Tata Consultancy Services Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    Role- Data EngineerRequired Technical Skill Set - Data Engineer in AWS RedshiftGood to have Technical Skill SetData Analysis, Data Engineering, SQL/No SQL, EC2/S3Desired Experience Range - 6+ yearsLocation of RequirementChennai / Hyderabad /KolkataMust-Have**(Ideally should not be more than 3-5)Good hands on in database design, data flow and analysis...

  • AWS Data engineer

    1 week ago

    Chennai, Tamil Nadu, India Virtusa Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    AWS Data EngineerDesign and build scalable data pipelines using AWS services like AWS Glue, Amazon Redshift, and S3.Develop efficient ETL processes for data extraction, transformation, and loading into data warehouses and lakes.Create and manage applications using Python, SQL, Databricks, and various AWS technologies.Automate repetitive tasks and build...

  • AWS Data Engineer

    1 week ago

    Hyderabad, India Coforge Full time

    We’re Hiring: AWS Data Engineers at Coforge Ltd. Immediate Joiners Preferred.Job Locations: Hyderabad & Greater NoidaExperience Required: 5 to 7 YearsSend your CV to Gaurav.2.Kumar@coforge.comAbout the Role: As an AWS Data Engineer, you will be responsible for designing, developing, and optimizing robust, scalable, and secure data pipelines and...

  • AWS Data Engineer

    5 days ago

    Hyderabad, India Coforge Full time

    We’re Hiring: AWS Data Engineers at Coforge Ltd. Immediate Joiners Preferred.Job Locations: Hyderabad & Greater NoidaExperience Required: 5 to 7 YearsSend your CV to Gaurav.2.Kumar@coforge.comAbout the Role: As an AWS Data Engineer, you will be responsible for designing, developing, and optimizing robust, scalable, and secure data pipelines and...

  • AWS Data Engineer

    1 week ago

    Hyderabad, India Coforge Full time

    We’re Hiring : AWS Data Engineers at Coforge Ltd . Immediate Joiners Preferred. Job Locations: Hyderabad & Greater Noida Experience Required: 5 to 7 Years Send your CV to About the Role: As an AWS Data Engineer, you will be responsible for designing, developing, and optimizing robust, scalable, and secure data pipelines and infrastructure on AWS. You’ll...

  • AWS Data Engineer

    1 week ago

    Hyderabad, India Coforge Full time

    We’re Hiring: AWS Data Engineers at Coforge Ltd. Immediate Joiners Preferred.Job Locations: Hyderabad & Greater NoidaExperience Required: 5 to 7 YearsSend your CV to the Role: As an AWS Data Engineer, you will be responsible for designing, developing, and optimizing robust, scalable, and secure data pipelines and infrastructure on AWS. You’ll work with...

  • Aws data engineer

    3 weeks ago

    Hyderabad, India Coforge Full time

    We’re Hiring: AWS Data Engineers at Coforge Ltd. Immediate Joiners Preferred.Job Locations: Hyderabad & Greater NoidaExperience Required: 5 to 7 YearsSend your CV to Gaurav.2. About the Role: As an AWS Data Engineer, you will be responsible for designing, developing, and optimizing robust, scalable, and secure data pipelines and infrastructure on AWS....

  • AWS Data Engineer

    2 days ago

    Hyderabad, India Coforge Full time

    We’re Hiring : AWS Data Engineers at Coforge Ltd . Immediate Joiners Preferred. Job Locations: Hyderabad & Greater Noida Experience Required: 5 to 7 Years Send your CV to About the Role: As an AWS Data Engineer, you will be responsible for designing, developing, and optimizing robust, scalable, and secure data pipelines and infrastructure on AWS. You’ll...

  • AWS Data Engineer

    2 days ago

    hyderabad, India Coforge Full time

    We’re Hiring : AWS Data Engineers at Coforge Ltd . Immediate Joiners Preferred. Job Locations: Hyderabad & Greater Noida Experience Required: 5 to 7 Years Send your CV to About the Role: As an AWS Data Engineer, you will be responsible for designing, developing, and optimizing robust, scalable, and secure data pipelines and infrastructure on AWS. You’ll...

  • AWS Data Engineer

    2 weeks ago

    Chennai, Tamil Nadu, India Coderz Vision Technology® Full time US$ 90,000 - US$ 1,20,000 per year

    Job Title:Data EngineerRequired Experience: 3+ yrsJob SummaryWe are seeking a highly skilled and experienced Data Engineer for AWS to join our team and play a crucial role in designing and implementing data analytics solutions on the Amazon Web Services (AWS) platform. The ideal candidate will have a deep understanding of data analytics technologies, AWS...