lead Data Engineer

3 weeks ago

Ballari, India Cozzera Full time

Job Title: Lead Data EngineerExperience: 8–10 YearsLocation: Remote ( 1 week from noida office then remote)Job Overview:We are looking for an accomplished Lead Data Engineer with 8–10 years of experience inarchitecting, building, and managing complex data ecosystems using Python, Databricks(Delta Lake, Spark, MLflow), and modern orchestration frameworks. The candidate shouldpossess strong leadership and technical acumen to drive data strategy, pipelineoptimization, and AI/ML workflow automation across large-scale projects.The role involves architecting scalable data solutions, ensuring data governance andcompliance (HIPAA, SOC 2, GDPR), and mentoring data engineering teams to deliver highperformance solutions in healthcare or life sciences domains.Key Responsibilities:Lead the architecture, design, and implementation of scalable and reliable datasolutions using Databricks, Delta Lake, and Spark.Oversee the development and optimization of ETL/ELT pipelines using Python andmodern orchestration tools (Airflow, Prefect, Dagster).Drive data platform modernization and migration to cloud-native architectures(AWS, Azure, or GCP).Collaborate with Data Scientists, Analysts, and Architects to enable advancedanalytics and ML model deployment using MLflow.Establish and enforce data engineering standards, best practices, and code reviewsacross teams.Ensure data governance, lineage, and compliance with regulatory frameworks(HIPAA, SOC 2, GDPR).Manage performance tuning, cost optimization, and scalability planning for dataworkflows.Mentor and guide junior data engineers, fostering a culture of technical excellence.Partner with stakeholders to align business objectives with data strategy and deliveryroadmap.Technical Skills Required:Languages: Python, SQL, PySparkData Platforms: Databricks, Delta Lake, MLflow, Apache SparkWorkflow Orchestration: Airflow, Prefect, DagsterCloud Platforms: AWS, Azure, or GCP (with focus on data services)Data Architecture: Data Lakes, Warehouses, and Streaming ArchitecturesDevOps & Version Control: Git, Jenkins, Terraform, CI/CD pipelinesGovernance & Security: HIPAA, SOC 2, GDPR compliance expertiseNice to Have: Knowledge of Kafka, dbt, and Infrastructure-as-Code (IaC) toolsSoft Skills:Proven leadership and mentorship capabilitiesExcellent communication and client interaction skillsStrategic mindset with strong analytical and problem-solving abilityAbility to manage multiple projects and distributed teams in Agile environmentsEducation:Bachelor’s or Master’s degree in Computer Science, Data Engineering, or related fieldChances of ClosureYes

  • Data Engineer

    3 days ago

    Ballari, India Sapphire Software Solutions Inc Full time

    HI FolksPlease check the JD and share your updated resume to my email naresh@sapphiresoftwaresolutions.com and ping me on whatsapp (+91 970-529-6474) along with your resumeData Engineer100% Remote1 year contractJOB DESCRIPTIONA global law firm with nearly 1,400 lawyers and more than 3,000 employees across 19 offices in the United States, Europe, and Asia is...

  • Lead Engineer

    3 days ago

    Ballari, India Mancer Consulting Services Full time

    Job Title: Lead EngineerKey Responsibilities:•Shared Responsibility Models: Define and implement clear shared responsibility models, ensuring accountability across teams for infrastructure, platforms and application security and reliability.•Compliance and Policy as Code: Create roadmaps to embed our SDLC into code together with the platform teams,...

  • Senior Data Engineer

    1 week ago

    Ballari, India ACL Digital Full time

    Job Description: Tech Lead design, build, and maintain the infrastructure for an organization's data, ensuring it is reliable, accessible, and optimized for use by data scientists and analysts. Key responsibilities include creating and managing data pipelines, optimizing data storage and processing, ensuring data quality and security, and collaborating with...

  • Data Engineer

    4 days ago

    ballari, India Pro5 Full time

    About the RoleOur client is seeking a Data Engineer to build and maintain data pipelines supporting AI agents for real estate and construction applications. You'll play a key role in ensuring reliable data flows, integrations, and preprocessing frameworks that power advanced GenAI systems.This is a high-impact opportunity within an early-stage, fast-growing...

  • Founding data engineer

    7 days ago

    Ballari, India InSiteVerse Full time

    Equity Only (No Monetary Compensation) | Pre-Seed Stage Startup About Us We are building a next-generation AI-driven trading platform  that ingests massive streams of financial, alternative, and sentiment data and transforms them into actionable insights. Our mission is to combine robust data engineering pipelines  with Generative AI and advanced ML...

  • Lead Sustenance Engineer

    3 weeks ago

    Ballari, India DDN Full time

    This is an incredible opportunity to be part of a company that has been at the forefront of AI and high-performance data storage innovation for over two decades. DataDirect Networks (DDN) is a global market leader renowned for powering many of the world's most demanding AI data centers, in industries ranging from life sciences and healthcare to financial...

  • Vice President-Data Engineer-Risk Models

    1 week ago

    Ballari, India Mashreq Full time

    Job PurposeTo design and maintain batch data pipelines, drive data strategy, and enhance data architecture & best practices. This role requires deep expertise in core banking, retail, digital, marketing, risk, and compliance systems across multiple regions (UAE, Egypt, Pakistan, etc.). The function spans Enterprise Data Lake, Azure Data Lake, BI, Advanced...

  • Data scientist

    1 week ago

    Ballari, India Deloitte Full time

    Your potential, unleashed. India’s impact on the global economy has increased at an exponential rate and Deloitte presents an opportunity to unleash and realize your potential amongst cutting edge leaders, and organizations shaping the future of the region, and indeed, the world beyond. At Deloitte, your whole self to work, every day. Combine that with our...

  • Senior solutions architect – data

    1 day ago

    Ballari, India Celito Tech, Inc. Full time

    Job Title: Senior Solutions Architect – Data & Analytics (Life Sciences) Employment Type: Full-Time Timings : Can extend upto 11 pm IST The Celito Team The Celito Team architects the buildout of simplified, integrated, and compliant technology stacks. With both consulting and products, our expertise can help our customers save time and money as they move...

  • Big Data Specialist

    2 days ago

    Ballari, India Atomic North Full time

    Big Data Engineer Location: Pune/Nagpur (WFO) Experience Required: 8+ Years **Long term onsite to Abu Dhabi**Job Summary: We are looking for an experienced Big Data Engineer with strong expertise in PySpark and Big Data ecosystems. The ideal candidate will be responsible for designing, developing, and optimizing scalable data pipelines while ensuring high...