Sr. Data Engineer – AWS Databricks

4 days ago

Hyderabad, Telangana, India Gravity Infosolutions, Inc. Full time ₹ 8,00,000 - ₹ 12,00,000 per year

Sr. Data Engineer – AWS Databricks / Data Tech Lead

Type: Contract

Location : Chennai / Hyd

Experience: 5+ years

Duration: 3 Months+ Extendable

Key Responsibilities

  • Data Pipeline Development:
    Design and implement robust ETL/ELT pipelines using Databricks, PySpark, and Delta Lake to process structured and unstructured data efficiently.
  • Manage job orchestration, scheduling, and workflow automation through
    Databricks Workflows
    or
    Airflow
    .
  • Performance Optimization:
    Tune and optimize Databricks clusters and notebooks for performance, scalability, and cost-efficiency.
  • Data Governance:
    Implement
    data governance and lineage
    using
    Unity Catalog
    and other platform-native features
  • Collaboration:
    Work closely with data scientists, analysts, and business stakeholders to understand data requirements and deliver solutions that meet business needs.
  • Cloud Integration:
    Leverage cloud platforms (AWS) to build and deploy data solutions, ensuring seamless integration with existing infrastructure.
  • Data Modeling:
    Develop and maintain data models that support analytics and machine learning workflows.
  • Automation & Monitoring:
    Implement automated testing, monitoring, and alerting mechanisms to ensure data pipeline reliability and data quality.
  • Documentation & Best Practices:
    Maintain comprehensive documentation of data workflows and adhere to best practices in coding, version control, and data governance.

Required Qualifications

  • Experience:
    5+ years in data engineering, with hands-on experience using Databricks and Apache Spark.
  • Programming Skills:
    Proficiency in Python and SQL;
  • Cloud Platforms:
    Strong experience with cloud services such as AWS (e.g., S3, Glue, Redshift
  • Data Engineering Tools:
    Familiarity with tools like Airflow, Kafka, and dbt.
  • Data Modeling:
    Experience in designing data models for analytics and machine learning applications.
  • Collaboration:
    Proven ability to work in cross-functional teams and communicate effectively with non-technical stakeholders.

Primary Skill Set

Databricks, Apache Spark/Pyspark, Python, SQL, ETL/ELT development, Delta Lake, Cloud platforms (AWS), Data modeling, Cross-functional collaboration, Communication

Secondary Skill Set

Airflow, dbt, Kafka, Hadoop, MLflow, Unity Catalog, Delta Live Tables, Cluster optimization, Data governance, Security and compliance, Databricks certifications

  • AWS-Databricks Engineer

    4 days ago

    Hyderabad, Telangana, India Coforge Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    We are seeking an experiencedAWS Databricks Developerto design, develop, and maintain scalable data processing and analytics solutions on theAWS and Databricksplatform. The ideal candidate will have strong expertise in building data pipelines, optimizing performance, and integrating multiple AWS services to deliver high-quality data solutions.Key...

  • Databricks Engineer

    6 hours ago

    Hyderabad, Telangana, India NTT DATA Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Design, build, and maintain robust ETL/ELT data pipelines using Apache Spark on Databricks. Implement data Lakehouse architecture using Delta Lake for cost-effective data storage and analytics. Use Databricks Workflows for orchestrating batch and streaming pipelines. Develop and maintain CI/CD pipelines for data applications using tools such as Azure DevOps,...

  • Databricks Engineer

    2 weeks ago

    Hyderabad, Telangana, India Oblytech Full time US$ 90,000 - US$ 1,20,000 per year

    Job Title:Databricks Engineer (PySpark Developer)Employment Type:Full-Time | Permanent | Remote (Work From Home)Industry:IT Services & Consulting | Software Development | Data Engineering | Cloud ServicesFunctional Area:Data Engineering | Big Data | Cloud Platforms | AnalyticsAbout Oblytech:Oblytech is a fast-growing IT consulting and software services firm,...

  • Data Engineer

    4 weeks ago

    Hyderabad, Telangana, India, Telangana Tata Consultancy Services Full time

    Greetings from TCS!!! TCS is hiring Data Engineer (Databricks) Location – PAN INDIA Years of Experience – 10-16 yearsJob DescriptionRole - Senior Data Engineer – DatabricksRequired Technical Skill SetDatabricks, PySpark, Delta Lake, MLflow, Azure/AWS/GCP, Data Lakehouse architecture, CI/CD, DataOpsDesired Competencies Must-HaveExpertise in building...

  • Sr. Manager Data Engineering

    2 days ago

    Hyderabad, Telangana, India Amgen Inc Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    What you doWe are seeking a seasoned Sr Manager of Data Engineering to drive the development and implementation of our data strategy for Manufacturing and Clinical Supply Chain. The ideal candidate possesses a strong blend of technical expertise and data-driven problem-solving skills. As a Sr Manager Data Engineering, you will play a crucial role in leading,...

  • AWS Databricks Developer

    1 week ago

    Hyderabad, Telangana, India Coforge Full time ₹ 5,00,000 - ₹ 15,00,000 per year

    AWS Databricks DeveloperMandatory Skills- AWS Databricks Experience - 5-7 Years Mode- 5 days WFO Two client round (One f2f mandatory) Share your updated resume now.

  • Senior / Lead - Data Engineer - AWS

    6 days ago

    Hyderabad, Telangana, India Blend Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    *Company Description*Blend is a premier AI services provider, committed to co-creating meaningful impact for its clients through the power of data science, AI, technology, and people. With a mission to fuel bold visions, Blend tackles significant challenges by seamlessly aligning human expertise with artificial intelligence. The company is dedicated to...

  • Senior Data Engineer/Architect

    7 days ago

    Hyderabad, Telangana, India Enable Data Incorporated Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Experience Required: 8+YearsMode of work: RemoteSkills Required: Azure DataBricks, Eventhub, Kafka, Architecture,Azure Data Factory, Pyspark, Python, SQL, Spark,Copilot Studio , Databricks Lakehouse Platform, its architecture, and its capabilities.Notice Period : Immediate Joiners/ Permanent/Contract role (Can join within 15th September...

  • Databricks+spark

    2 days ago

    Hyderabad, Telangana, India Cognizant Technology Solutions Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Job SummaryWe are seeking a highly skilled Sr. Developer with 8 to 12 years of experience to join our team in a hybrid work model. The ideal candidate will have expertise in Databricks SQL Databricks Delta Lake Databricks Workflows and PySpark. Experience in Sales & Marketing domains is a plus. The role involves developing and optimizing data solutions to...

  • Senior Data Engineer

    2 weeks ago

    Hyderabad, Telangana, India Enable Data Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Experience Required: 8+YearsMode of work: RemoteSkills Required: Azure DataBricks, Eventhub, Kafka, Architecture,Azure Data Factory, Pyspark, Python, SQL, SparkNotice Period : Immediate Joiners/ Permanent/Contract role (Can join within September 15th 2025)Design, develop, and maintain scalable and robust data solutions in the cloud using Apache Spark and...