Principal Data Engineer

2 weeks ago

Bengaluru, Karnataka, India Neemtree Tech Hiring Full time ₹ 12,00,000 - ₹ 30,00,000 per year

Description :

Responsibilities :

- Define and lead the data architecture vision and strategy, ensuring it supports analytics, ML, and business operations at scale.

- Architect and manage cloud-native data platforms using Databricks and AWS, leveraging the lakehouse architecture to unify data engineering and ML workflows.

- Build and optimise large-scale batch and streaming pipelines using Apache Spark, Airflow, and AWS Glue, ensuring high availability and fault tolerance.

- Design and develop data marts, warehouses, and analytics-ready datasets tailored for BI, product, and data science teams.

- Implement robust ETL/ELT pipelines with a focus on reusability, modularity, and automated testing.

- Enforce and scale data governance practices, including data lineage, cataloguing, access management, and compliance with security and privacy standards.

- Partner with ML Engineers and Data Scientists to build and deploy ML pipelines, leveraging Databricks MLflow, Feature Store, and MLOps practices.

- Provide architectural leadership across data modelling, data observability, pipeline monitoring, and CI/CD for data workflows.

- Evaluate emerging tools and frameworks, recommending technologies that align with platform scalability and cost-efficiency.

- Mentor data engineers and foster a culture of technical excellence, innovation, and ownership across data teams.

Requirements :

- 12+ years of hands-on experience in data engineering, with at least 4 years in a lead or architect-level role.

- Deep expertise in Apache Spark, with proven experience developing large-scale distributed data processing pipelines.

- Strong experience with Databricks platform and its internal ecosystem (e. g., Delta Lake, Unity Catalogue, MLflow, Job orchestration, Workspaces, Clusters, Lakehouse architecture).

- Extensive experience with workflow orchestration using Apache Airflow.

- Proficiency in both SQL and NoSQL databases (e. g., Postgres, DynamoDB, MongoDB, Cassandra) with a deep understanding of schema design, query tuning, and data partitioning.

- Proven background in building data warehouse/data mart architectures using AWS services like Redshift, Athena, Glue, Lambda, DMS, and S3

- Strong programming and scripting ability in Python (preferred) or other AWS-compatible languages.

- Solid understanding of data modelling techniques, versioned datasets, and performance tuning strategies.

- Hands-on experience implementing data governance, lineage tracking, data cataloguing, and compliance frameworks (GDPR, HIPAA, etc. ).

- Experience with real-time data streaming using tools like Kafka, Kinesis, or Flink.

- Working knowledge of MLOps tooling and workflows, including automated model deployment, monitoring, and ML pipeline orchestration.

- Familiarity with MLflow, Feature Store, and Databricks-native ML tooling is a plus.

- Strong grasp of CI/CD for data and ML pipelines, automated testing, and infrastructure-as-code (Terraform, CDK, etc. ).

- Excellent communication, leadership, and mentoring skills with a collaborative mindset and the ability to influence across functions.

  • Principal Technical Recruiter

    2 weeks ago

    Bengaluru, Karnataka, India Hevo Data Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    About Hevo: At Hevo Data, we're building the future of data infrastructure for AI. Over 2,000 companies across 40+ countries trust Hevo to power their analytics. As a deep tech company, our engineering team solves some of the hardest problems in data integration, scale, and reliability. We're looking for a Principal Recruiter who goes beyond keyword...

  • Principal Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India GSK Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Job Description Job Title: Principal Data Engineer Job Purpose: This role requires a blend of leadership and hands-on technical expertise. The candidate will be responsible for leading data engineering strategy and delivery across Manufacturing & Engineering data products within Global Supply Chain Data & AI organization. This includes collaborating with...

  • Principal Data Architect

    4 days ago

    Bengaluru, Karnataka, India NTT DATA Global Delivery Services Ltd Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Principal Data Architect Make an impact with NTT DATA Join a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it's a place where you can grow, belong and thrive.Your...

  • Principal Engineer

    12 hours ago

    Bengaluru, Karnataka, India Getinz Techno Services Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Principal Engineer (Data Platform) - GNS - BLR Hiring for a leading digital security company has client across global. Job Title: Principal Engineer – Data PlatformWe are looking for a seasoned Principal Engineer to lead the design and development of next-generation data pipelines that enable near real-time ingestion and processing of massive datasets...

  • Principal/Sr. Principal-Data Scientist

    2 weeks ago

    Bengaluru, Karnataka, India Symmetrical Global Search Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    We are Hiring For Principal/Sr. Principal-Data ScientistExperience: 9+ yearsJob descriptionDevelop, Test, and Deploy ML/AI models for various productsPerform data preprocessing, feature engineering and ML/DL model evaluationOptimize and fine-tune models for performance and scalabilityGood understanding of Statistical, ML, AI modelsGood understanding of NLP...

  • Principal Engineer

    2 weeks ago

    Bengaluru, Karnataka, India Optiv Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Role : The Principal Engineer The Principal Engineer will be responsible for creation of procedures, implementation of processes and development of staff for managing and maintaining security systems across internal and client environments. The Principal Engineer will work closely with Management, Senior Engineers, Solution Architects, Senior...

  • Principal Data

    1 week ago

    Bengaluru, Karnataka, India Waters Corporation Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    OverviewOur Center for Process Excellence team is on a mission to improve business outcomes and employee experiences by driving step-change improvements in critical enterprise processes, and the technology and analytics supporting these. We are looking for a Principal Data/App Engineer to join our Business Intelligence team, and the broader Data Engineer...

  • Principal Data Engineer

    2 days ago

    Bengaluru, Karnataka, India Skyworks Solutions, Inc. Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    If you are looking for a challenging and exciting career in the world of technology, then look no further. Skyworks is an innovator of high performance analog semiconductors whose solutions are powering the wireless networking revolution. At Skyworks, you will find a fast-paced environment with a strong focus on global collaboration, minimal layers of...

  • Principal Data Engineer

    10 hours ago

    Bengaluru, Karnataka, India GSK Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Site Name: Bengaluru Luxor North TowerPosted Date: Sep Job SummaryThe Cyber Security organization at GSK is seeking a highly skilled and experienced Principal Data Engineer to focus on cyber data analytics. This role is integral to enabling data-driven insights for our metrics and data science teams, ensuring the secure and efficient handling of data within...

  • Principal Data Engineer

    9 hours ago

    Bengaluru, Karnataka, India GSK Full time ₹ 2,00,00,000 - ₹ 2,50,00,000 per year

    Site Name:Bengaluru Luxor North TowerPosted Date:Oct Job SummaryThe Cyber Security organization at GSK is seeking a highly skilled and experiencedPrincipal Data Engineerto focus oncyber data analytics. This role is integral to enabling data-driven insights for our metrics and data science teams, ensuring the secure and efficient handling of data within...