Sr. Data Engineer – AWS Databricks

5 days ago

Hyderabad, Telangana, India Gravity Infosolutions, Inc. Full time ₹ 8,00,000 - ₹ 12,00,000 per year

Sr. Data Engineer – AWS Databricks / Data Tech Lead

Type: Contract

Location : Chennai / Hyd

Experience: 5+ years

Duration: 3 Months+ Extendable

Key Responsibilities

  • Data Pipeline Development:
    Design and implement robust ETL/ELT pipelines using Databricks, PySpark, and Delta Lake to process structured and unstructured data efficiently.
  • Manage job orchestration, scheduling, and workflow automation through
    Databricks Workflows
    or
    Airflow
    .
  • Performance Optimization:
    Tune and optimize Databricks clusters and notebooks for performance, scalability, and cost-efficiency.
  • Data Governance:
    Implement
    data governance and lineage
    using
    Unity Catalog
    and other platform-native features
  • Collaboration:
    Work closely with data scientists, analysts, and business stakeholders to understand data requirements and deliver solutions that meet business needs.
  • Cloud Integration:
    Leverage cloud platforms (AWS) to build and deploy data solutions, ensuring seamless integration with existing infrastructure.
  • Data Modeling:
    Develop and maintain data models that support analytics and machine learning workflows.
  • Automation & Monitoring:
    Implement automated testing, monitoring, and alerting mechanisms to ensure data pipeline reliability and data quality.
  • Documentation & Best Practices:
    Maintain comprehensive documentation of data workflows and adhere to best practices in coding, version control, and data governance.

Required Qualifications

  • Experience:
    5+ years in data engineering, with hands-on experience using Databricks and Apache Spark.
  • Programming Skills:
    Proficiency in Python and SQL;
  • Cloud Platforms:
    Strong experience with cloud services such as AWS (e.g., S3, Glue, Redshift
  • Data Engineering Tools:
    Familiarity with tools like Airflow, Kafka, and dbt.
  • Data Modeling:
    Experience in designing data models for analytics and machine learning applications.
  • Collaboration:
    Proven ability to work in cross-functional teams and communicate effectively with non-technical stakeholders.

Primary Skill Set

Databricks, Apache Spark/Pyspark, Python, SQL, ETL/ELT development, Delta Lake, Cloud platforms (AWS), Data modeling, Cross-functional collaboration, Communication

Secondary Skill Set

Airflow, dbt, Kafka, Hadoop, MLflow, Unity Catalog, Delta Live Tables, Cluster optimization, Data governance, Security and compliance, Databricks certifications

  • AWS-Databricks Engineer

    5 days ago

    Hyderabad, Telangana, India Coforge Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    We are seeking an experiencedAWS Databricks Developerto design, develop, and maintain scalable data processing and analytics solutions on theAWS and Databricksplatform. The ideal candidate will have strong expertise in building data pipelines, optimizing performance, and integrating multiple AWS services to deliver high-quality data solutions.Key...

  • Sr. Manager Data Engineering

    2 days ago

    Hyderabad, Telangana, India Amgen Inc Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    What you doWe are seeking a seasoned Sr Manager of Data Engineering to drive the development and implementation of our data strategy for Manufacturing and Clinical Supply Chain. The ideal candidate possesses a strong blend of technical expertise and data-driven problem-solving skills. As a Sr Manager Data Engineering, you will play a crucial role in leading,...

  • Senior Databricks Engineer

    3 days ago

    Hyderabad, Telangana, India SID Information Technologies Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Role: Senior Data Engineer (Python, Spark/Databricks, SQL, AWS)Experience:6–12 yearsLocation:HyderabadWork Mode:Hybrid (3 days/week in-office)Join Time:ImmediateMust-Have Technical Skills:Strong programming skills in Python, DatabricksHands-on experience with Apache Spark & Databricks for big data processing on AWS cloudProficiency with AWS services ...

  • Sr. Data Engineer

    1 week ago

    Hyderabad, Telangana, India Blumetra Full time ₹ 8,00,000 - ₹ 16,00,000 per year

    Job Title: Senior Data EngineerExperience: 6 - 8 yearsLocation: HybridEmployment Type: Full-timeMandatory skills: AWS, Python, SQL, DatabricksAbout the RoleWe are looking for a highly skilled Senior Data Engineer who is passionate about building robust, scalable, and high-performance data systems. The ideal candidate will have deep expertise in SQL, Python,...

  • Databricks+spark

    1 day ago

    Hyderabad, Telangana, India Cognizant Technology Solutions Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Job SummaryWe are seeking a highly skilled Sr. Developer with 8 to 12 years of experience to join our team in a hybrid work model. The ideal candidate will have expertise in Databricks SQL Databricks Delta Lake Databricks Workflows and PySpark. Experience in Sales & Marketing domains is a plus. The role involves developing and optimizing data solutions to...

  • Sr. Data Engineer

    2 weeks ago

    Hyderabad, Telangana, India EduRun Group Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Minimum 8+ years of working experience in Technology (application development and production support) and Minimum 5+ years of experience in developing & supporting ETLs and Python, Databricks, Pyspark.Experience with Python, Spark, and Hive and Understanding of data-warehousing and datamodeling techniques.Knowledge of industry-wide visualization and...

  • Databricks Engineer

    5 days ago

    Hyderabad, Telangana, India Anblicks Solutions Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    Role & responsibilities5+ years of experience in data engineering roles.• Proficiency in programming languages such as Scala or Python, or Java.• Expertise in distributed data processing frameworks like Apache Spark or Flink.• Strong knowledge of cloud platforms (e.g., AWS) and cloud-native data platforms like Databricks or Redshift.• Solid...

  • Pyspark + Databricks

    2 days ago

    Hyderabad, Telangana, India Cognizant Technology Solutions Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Job SummaryWe are seeking a highly skilled Sr. Developer with 6 to 10 years of experience to join our team. The ideal candidate will have expertise in Databricks SQL Databricks Workflows and PySpark. Experience in the Cards & Payments domain is a plus. This is a hybrid work model with day shifts and no travel required.ResponsibilitiesDevelop and maintain...

  • Senior Databricks Engineer

    1 day ago

    Hyderabad, Telangana, India Xenon7 Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    About us:Where elite tech talent meets world-class opportunitiesAt Xenon7, we work with leading enterprises and innovative startups on exciting, cutting-edge projects that leverage the latest technologies across various domains of IT including Data, Web, Infrastructure, AI, and many others. Our expertise in IT solutions development and on-demand resources...

  • Big Data Engineer

    7 days ago

    Hyderabad, Telangana, India Techno Facts Solutions Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Experience in developing and delivering scalable big data pipelines using Apache Spark and Databricks on AWS.Position Requirements :Must Have : Build and maintain scalable data pipelines using Databricks and Apache Spark. Develop and optimize ETL/ELT processes for structured and unstructured data. Knowledge of Lakehouse architecture for efficient data...