Sr. Data Engineer – AWS Databricks

1 week ago

New Delhi, India Gravity Infosolutions, Inc. Full time

Role: Sr. Data Engineer – AWS Databricks / Data Tech LeadType: ContractLocation: Chennai / HyderabadExperience: 5+ yearsDuration: 3 Months+ ExtendableKey Responsibilities:- Data Pipeline Development: Design and implement robust ETL/ELT pipelines using Databricks, PySpark, and Delta Lake to process structured and unstructured data efficiently. - Manage job orchestration, scheduling, and workflow automation through Databricks Workflows or Airflow. - Performance Optimization: Tune and optimize Databricks clusters and notebooks for performance, scalability, and cost-efficiency. - Data Governance: Implement data governance and lineage using Unity Catalog and other platform-native features - Collaboration: Work closely with data scientists, analysts, and business stakeholders to understand data requirements and deliver solutions that meet business needs. - Cloud Integration: Leverage cloud platforms (AWS) to build and deploy data solutions, ensuring seamless integration with existing infrastructure. - Data Modeling: Develop and maintain data models that support analytics and machine learning workflows. - Automation & Monitoring: Implement automated testing, monitoring, and alerting mechanisms to ensure data pipeline reliability and data quality. - Documentation & Best Practices: Maintain comprehensive documentation of data workflows and adhere to best practices in coding, version control, and data governance.Required Qualifications:- Experience: 5+ years in data engineering, with hands-on experience using Databricks and Apache Spark. - Programming Skills: Proficiency in Python and SQL; - Cloud Platforms: Strong experience with cloud services such as AWS (e.g., S3, Glue, Redshift - Data Engineering Tools: Familiarity with tools like Airflow, Kafka, and dbt. - Data Modeling: Experience in designing data models for analytics and machine learning applications. - Collaboration: Proven ability to work in cross-functional teams and communicate effectively with non-technical stakeholders.Primary Skill Set:Databricks, Apache Spark/Pyspark, Python, SQL, ETL/ELT development, Delta Lake, Cloud platforms (AWS), Data modeling, Cross-functional collaboration, CommunicationSecondary Skill Set:Airflow, dbt, Kafka, Hadoop, MLflow, Unity Catalog, Delta Live Tables, Cluster optimization, Data governance, Security and compliance, Databricks certifications.

  • Sr. Data Engineer – AWS Databricks

    6 days ago

    New Delhi, India Gravity Infosolutions, Inc. Full time

    Role: Sr. Data Engineer – AWS Databricks / Data Tech Lead Type: Contract Location: Chennai / Hyderabad Experience: 5+ years Duration: 3 Months+ ExtendableKey Responsibilities: Data Pipeline Development:Design and implement robust ETL/ELT pipelines using Databricks, PySpark, and Delta Lake to process structured and unstructured data efficiently. Manage job...

  • Sr. Data Engineer – AWS Databricks

    1 week ago

    New Delhi, India Gravity Infosolutions, Inc. Full time

    Sr. Data Engineer – AWS Databricks / Data Tech Lead Type: Contract Location : Chennai / Hyd Experience: 5+ years Duration: 3 Months+ ExtendableKey ResponsibilitiesData Pipeline Development:Design and implement robust ETL/ELT pipelines using Databricks, PySpark, and Delta Lake to process structured and unstructured data efficiently. Manage job...

  • Senior Data Engineer

    3 weeks ago

    New Delhi, India Accolade Full time

    About AccoladeThe multifamily real estate industry is undergoing a massive transformation, and Accolade is at the forefront. We are building the industry's first AI-native Operations Centralization Platform, designed to streamline complex processes, unlock new efficiencies, and create better experiences for residents and operators alike. Our platform uses...

  • AWS Databricks Developer

    3 weeks ago

    New Delhi, India Coforge Full time

    We are seeking an experienced AWS Databricks Developer to design, develop, and maintain scalable data processing and analytics solutions on the AWS and Databricks platform. The ideal candidate will have strong expertise in building data pipelines, optimizing performance, and integrating multiple AWS services to deliver high-quality data solutions.Key...

  • Databricks Data Engineer

    3 weeks ago

    New Delhi, India Ascendion Full time

    Job Title: Senior Data EngineerExperience : 3+ yearsLocation: Gurgaon /Pune / BangaloreSkills: PySpark, SQL, Databricks, AWS.Role Summary:We are looking for 3–4 experienced Databricks Developers to support a fast-paced, high-impact data engineering initiative. The ideal candidates should have hands-on expertise in building scalable data pipelines using...

  • Sr Data Engineer

    2 weeks ago

    New Delhi, India Populace World Solutions Full time

    Job Title: Sr. Data EngineerExperience: 8+ YearsLocation: Pune (Kharadi)Job Description- 8+ years of experience as a big data engineer. - Must be proficient with Python & PySpark - In-depth knowledge of Hadoop, Apache Spark, Databricks, Delta Tables, AWS data analytics services - Must have extensive experience with Delta Tables, JSON, Parquet file format -...

  • Databricks Data Engineer

    3 weeks ago

    New Delhi, India Ascendion Full time

    Job Title: Senior Data Engineer Experience : 3+ years Location: Gurgaon /Pune / BangaloreSkills: PySpark, SQL, Databricks, AWS.Role Summary: We are looking for3–4 experienced Databricks Developersto support a fast-paced, high-impact data engineering initiative. The ideal candidates should have hands-on expertise in buildingscalable data pipelines using...

  • Databricks Data Engineer

    3 weeks ago

    New Delhi, India Tata Consultancy Services Full time

    About the RoleThe Databricks Data Engineer will play a crucial role in migrating and optimizing data workflows, ensuring high performance and reliability in our data operations.Experience- 3 to 6 yearsLocation - Kolkata /Chennai/TrivandrumRequired Technical Skill Set ------ Databricks, AWS, Python & PySparkGood to have- Experience in AWS platform (S3, EC2,...

  • Databricks Data Engineer

    1 week ago

    New Delhi, India Ascendion Full time

    Job Title: Senior Data EngineerExperience : 3+ years Location: Gurgaon /Pune / BangaloreSkills: PySpark, SQL, Databricks, AWS.Role Summary: We are looking for3–4 experienced Databricks Developersto support a fast-paced, high-impact data engineering initiative. The ideal candidates should have hands-on expertise in buildingscalable data pipelines using...

  • AWS Databricks Developer

    2 weeks ago

    New Delhi, India Coforge Full time

    We are seeking an experiencedAWS Databricks Developerto design, develop, and maintain scalable data processing and analytics solutions on theAWS and Databricksplatform. The ideal candidate will have strong expertise in building data pipelines, optimizing performance, and integrating multiple AWS services to deliver high-quality data solutions.Key...