Leading Data Engineer

1 day ago

India beBeeData Full time ₹ 1,80,00,000 - ₹ 2,00,00,000

Job Title: Principal Data Architect

Leadership Role in Data Engineering

We are seeking a seasoned data engineer to shape the architecture of our data warehouse and mentor senior engineers.

About the Job:

  • Design and Development: Lead the design and development of holistic roadmaps for data warehouse offerings, ensuring smooth delivery of features.
  • Data Modeling Challenges: Solve complex data modeling challenges using modern marketing data suites and drive large-scale data initiatives.
  • Team Leadership: Lead and mentor a team of 4–5 Sr. Engineers, driving client communication, requirement gathering, and roadmap planning.
  • Risk Management: Identify risks and provide mitigation strategies to ensure successful project outcomes.

Required Skills and Qualifications:

  • Experience: 10+ years of experience in Data Engineering, with 4+ years leading teams.
  • Coding Expertise: Strong coding expertise: Python, JVM, and Shell scripting with production-grade experience.
  • Cloud-Native Applications: 5+ years in cloud-native, data-intensive applications with mandatory AWS expertise.
  • Data Warehouse Design: Proven experience in Data Warehouse design & development using modern DW tools.
  • Databricks and dbt: Hands-on with Databricks and dbt (mandatory).
  • Airflow: Expert in Airflow (workflow orchestration).
  • Spark Applications: Strong experience building & maintaining Spark applications.
  • File Formats: Deep understanding of file formats: Parquet, Delta Lake, OTFs.
  • CI/CD Pipelines: Proficiency in building CI/CD pipelines (GitHub Actions, Jenkins, or ArgoCD).
  • Unit Testing: Solid knowledge of unit testing & test automation frameworks.

Nice to Have:

  • Docker and Kubernetes: Familiarity with Docker/Kubernetes for containerization.
  • IaC Tools: Hands-on with IaC tools (Terraform, CDK, or CloudFormation).
  • Observability Systems: Exposure to observability systems (Datadog, Prometheus, Grafana).

Soft Skills:

  • Proactive Mindset: Proactive, business-value-oriented mindset.
  • Documentation and Communication: Strong documentation & communication skills.

  • Data Engineering Lead

    6 days ago

    India beBeeDataEngineering Full time ₹ 8,00,000 - ₹ 12,00,000

    Job Title: Data Engineering LeadJob DescriptionWe are seeking an experienced Data Engineering Lead to lead our data engineering team in setting up and implementing a data lake on cloud, as well as developing standardized data models. The ideal candidate will have experience with big data technologies and be able to develop scalable data pipelines.In this...

  • Lead Blockchain Data Engineer

    4 weeks ago

    India Paywaz Full time

    Role: Lead Blockchain Data Engineer & Market IntelligenceCompany: Paywaz.com LLC (Business Unit: PZ Coins – Crypto Copy Trading & DEX Intelligence Platform)Compensation: Equity only (no salary until profitability)About PZ CoinsPZ Coins (www.pzcoins.com) is building the next-generation crypto copy trading and ghost trading platform, powered by structured...

  • Lead Data Engineer

    4 weeks ago

    India Rackspace Technology Full time

    Lead Data EngineerREQUIREMENTSDemonstrate knowledge and real-world experience on Big data technologies A successful history of handling performance issues processing extracting issues and fixing bugs xc2xb7 Experience managing and optimizing big data data pipelines architectures and data sets xc2xb7 We are looking for a candidate with 7 years of...

  • Lead Azure Data Engineer

    6 days ago

    India RandomTrees Full time

    Immediate #HIRING for a highly motivated and experienced Lead Azure Data Engineer to join our growing team. We're a leading software company specializing in Artificial Intelligence, Machine Learning, Data Analytics, Innovative data solutions, Cloud-based technologies If you're passionate about building robust applications and thrive in a dynamic...

  • Lead Data Engineering Position

    2 weeks ago

    India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    We are looking for an experienced Senior Data Engineer to lead our data engineering efforts.Key ResponsibilitiesDesign and Develop Data PipelinesCollaborate with cross-functional teams to drive data-driven decision making.Implement and Optimize Data WorkflowsDevelop scalable and maintainable code using Azure and Databricks.Stay up-to-date with the latest...

  • Lead Data Platform Engineer

    3 days ago

    India Black Dog Labs Full time

    Position: Lead Data Platform EngineerLocation: Remote (collaboration across time zones), India or LATAM preferredEngagement Type: ContractLanguage: Fluent EnglishExperience: 9+ years in Data Engineering / Backend Engineering / DevOps, including leadership of a team (or end-to-end ownership of large, multi-stakeholder projects)About the RoleWe're looking for...

  • Lead Data Platform Engineer

    1 week ago

    India Black Dog Labs Full time

    Position : Lead Data Platform Engineer Location : Remote (collaboration across time zones), India or LATAM preferred Engagement Type : Contract Language : Fluent English Experience : 9+ years in Data Engineering / Backend Engineering / DevOps, including leadership of a team (or end-to-end ownership of large, multi-stakeholder projects) About the Role We're...

  • Freelance SAS Modeler Engineer

    1 week ago

    India Leading MNC Full time

    Looking for a Freelance SAS Modeler Engineer to join a team of rockstar developers. The candidate should have a minimum of 6+ yrs. of experience. There are multiple openings. If you're looking for freelance/ part time opportunity (along with your day job) & a chance to work with the top 0.1% of developers in the industry, this one is for you You will...

  • Lead Aws Data Engineer

    4 days ago

    India ACL Digital Full time

    Lead Data Engineer 7+ yrs exp Location: Balewadi, Pune Immediate joiners only. Responsibilities Multi-year work experience as a Platform Lead, Delivery Leader or similar role. Good working knowledge of Aws Services, Python, Pyspark, data modelling. Knowledge of columnar and NoSQL databases, predictive analytics, data visualization, and...

  • Lead Azure Data Engineer

    2 weeks ago

    India RandomTrees Full time

    Immediate #HIRING for a highly motivated and experienced Lead Azure Data Engineer to join our growing team. We're a leading software company specializing in Artificial Intelligence, Machine Learning, Data Analytics, Innovative data solutions, Cloud-based technologies If you're passionate about building robust applications and thrive in a dynamic...