lead Data Engineer

7 hours ago

Ballari, India Cozzera Full time

Job Title: Lead Data EngineerExperience: 8–10 YearsLocation: Remote ( 1 week from noida office then remote)Job Overview:We are looking for an accomplished Lead Data Engineer with 8–10 years of experience inarchitecting, building, and managing complex data ecosystems using Python, Databricks(Delta Lake, Spark, MLflow), and modern orchestration frameworks. The candidate shouldpossess strong leadership and technical acumen to drive data strategy, pipelineoptimization, and AI/ML workflow automation across large-scale projects.The role involves architecting scalable data solutions, ensuring data governance andcompliance (HIPAA, SOC 2, GDPR), and mentoring data engineering teams to deliver highperformance solutions in healthcare or life sciences domains.Key Responsibilities:Lead the architecture, design, and implementation of scalable and reliable datasolutions using Databricks, Delta Lake, and Spark.Oversee the development and optimization of ETL/ELT pipelines using Python andmodern orchestration tools (Airflow, Prefect, Dagster).Drive data platform modernization and migration to cloud-native architectures(AWS, Azure, or GCP).Collaborate with Data Scientists, Analysts, and Architects to enable advancedanalytics and ML model deployment using MLflow.Establish and enforce data engineering standards, best practices, and code reviewsacross teams.Ensure data governance, lineage, and compliance with regulatory frameworks(HIPAA, SOC 2, GDPR).Manage performance tuning, cost optimization, and scalability planning for dataworkflows.Mentor and guide junior data engineers, fostering a culture of technical excellence.Partner with stakeholders to align business objectives with data strategy and deliveryroadmap.Technical Skills Required:Languages: Python, SQL, PySparkData Platforms: Databricks, Delta Lake, MLflow, Apache SparkWorkflow Orchestration: Airflow, Prefect, DagsterCloud Platforms: AWS, Azure, or GCP (with focus on data services)Data Architecture: Data Lakes, Warehouses, and Streaming ArchitecturesDevOps & Version Control: Git, Jenkins, Terraform, CI/CD pipelinesGovernance & Security: HIPAA, SOC 2, GDPR compliance expertiseNice to Have: Knowledge of Kafka, dbt, and Infrastructure-as-Code (IaC) toolsSoft Skills:Proven leadership and mentorship capabilitiesExcellent communication and client interaction skillsStrategic mindset with strong analytical and problem-solving abilityAbility to manage multiple projects and distributed teams in Agile environmentsEducation:Bachelor’s or Master’s degree in Computer Science, Data Engineering, or related fieldChances of ClosureYes

  • Data engineer

    1 week ago

    Ballari, India Insight Global Full time

    Job DescriptionInsight Global is looking for a skilled senior level Data Engineer in Hyderabad or remote India for a large AAA gaming company on a contract for 3 months with possibility of extension or conversion. You will be assisting the Data and Analytics team on one of the company's largest game titles set to launch this fall. Your day-to-day will be...

  • Lead data architect

    7 days ago

    Ballari, India ACL Digital Full time

    Technology Skills and Project Experience:12 years of experience in modeling and business system designs.10 years hands on experience as Data Engineer/Architect with proven experience on Big Data and Data Lakes on AWS7 years of experience in below TechnologiesScripts/Programming language: SQL, Python, PROC, Windows FunctionsGit HubAWS: S3, Red Shift, GlueBig...

  • Senior data engineer

    4 days ago

    Ballari, India HealthyMe AI Full time

    About the RoleWe are seeking a Senior Data Engineer with deep expertise in building data pipelines and integrating healthcare data. You will report to the Head of AI and Engineering and be responsible for designing, building, and operating the backbone of our AI-powered applications. This is a critical role where you will create scalable pipelines that...

  • Data engineering with gcp

    7 days ago

    Ballari, India People Prime Worldwide Full time

    About Company: Our Client Corporation provides digital engineering and technology services to Forbes Global 2000 companies worldwide. Our Engineering First approach ensures we can execute all ideas and creatively solve pressing business challenges. With industry expertise and empowered agile teams, we prioritize execution early in the process for impactful...

  • Data Engineering Role

    1 week ago

    Ballari, India 100x.inc Full time

    Minimum Requirements:At least 3 years of professional experience in Data EngineeringDemonstrated end-to-end ownership of ETL pipelinesDeep, hands-on experience with AWS services: EC2, Athena, Lambda, and Step Functions (non-negotiable)Strong proficiency in MySQL (non-negotiable)Working knowledge of Docker: setup, deployment, and troubleshootingHighly...

  • Big data engineer

    7 days ago

    Ballari, India Alef Education Full time

    Who we areAlef Education began with a bold idea: that every learner deserves a personalised and meaningful education experience. What started in 2016 as a small pilot programme in Abu Dhabi has evolved into one of the world’s most dynamic Ed Tech companies—reshaping how millions of students engage with learning across the globe.Today, Alef is proudly...

  • Senior Generative AI Engineer

    4 weeks ago

    Ballari, India Ampstek Full time

    Title: Senior Generative AI Engineer (Databricks,Data Lake)Location: 100% RemoteJob Type: FulltimeKey Responsibilities• Design and implement GenAI models (LLMs, multimodal, embeddings, and fine-tuning) for enterprise use cases.• Architect and optimize data pipelines and workflows in Databricks for large-scale AI training and inference.• Manage and...

  • Senior Data Scientist

    1 week ago

    Ballari, India Delivery Hero Full time

    About Delivery Hero India: Delivery Hero India is part of Delivery Hero Group, the world’s leading local delivery platform. We operate in over 70+ countries worldwide, powered by tech but driven by people. Headquartered in Berlin, Germany. Delivery Hero has been listed on the Frankfurt Stock Exchange since 2017 and is part of the MDAX stock market index....

  • Lead Product Engineer

    3 weeks ago

    Ballari, India Cadence Design Systems, Inc. Full time

    At Cadence, we hire and develop leaders and innovators who want to make an impact on the world of technology. Job Title: Lead Product Engineer Location: Bangalore/Ahmedabad Cadence is a pivotal leader in electronic design, building upon more than 30 years of computational software expertise. The company applies its underlying Intelligent...

  • AI-Enabled Data Engineer

    7 hours ago

    Ballari, India Prophecy Technologies Full time

    Job Title: AI-Enabled Data Engineer (Azure | Teradata | Snowflake | Databricks)Experience Level: Mid-Level (5+ Years)Job Summary:We are looking for a dynamic and experienced Data Engineer with a strong foundation in SQL and hands-on expertise in Teradata, Snowflake, and Databricks, operating within Azure cloud environments. The ideal candidate will also have...