Data Engineering Leader

3 days ago

Ghaziabad, Uttar Pradesh, India beBeeDataEngineering Full time ₹ 15,00,000 - ₹ 25,00,000
Job Summary:

We are seeking a highly skilled and experienced Senior Data Engineer to join our team. The ideal candidate will have expertise in designing and implementing optimal data pipeline architectures, automating manual processes, and re-designing infrastructure for greater scalability.

This is an exciting opportunity for a seasoned professional to work with cutting-edge technologies such as SQL, big data, and cloud services like AWS/GCP. The successful candidate will be responsible for creating and maintaining efficient data processing systems, collaborating with data scientists to enhance functionality in our data systems, and developing data tools for analytics and data scientist team members.

  • Key Responsibilities:
  • Create and maintain optimal data pipeline architecture for efficient data extraction, transformation, and loading.
  • Design and implement internal process improvements by automating manual processes, optimizing data delivery, and re-designing infrastructure for greater scalability.
  • Build the infrastructure required for optimal data processing using SQL and big data technologies such as AWS.
  • Develop data tools for analytics and data scientist team members to assist them in building and optimizing our product into an innovative industry leader.
  • Collaborate with data scientists to enhance functionality in our data systems.
Required Skills and Qualifications:

The ideal candidate will possess the following skills and qualifications:

  • Proficiency in either Scala or Python, expertise in Spark, and experience with performance tuning and optimization.
  • Hands-on experience with dbt (Data Build Tool) for data transformations and data modeling.
  • Strong hands-on expertise in Apache Spark, including writing Spark jobs and tuning them for better performance.
  • Ability to handle large datasets efficiently and optimize Spark jobs for better performance.
  • Experience with big data tools: HDFS/S3, Spark/Flink, Hive, Hbase, Kafka/Kinesis, etc.
  • Experience with relational SQL and NoSQL databases, including Elasticsearch and Cassandra/Mongodb.
  • Experience with data pipeline and workflow management tools: Azkaban, Luigi, Airflow, etc.
  • Experience with cloud services such as AWS/GCP.
  • Experience with stream-processing systems: Spark-Streaming/Flink, etc.
  • Strong analytic skills related to working with structured/unstructured datasets.

What We Offer:

A competitive salary and benefits package, opportunities for career growth and professional development, and a dynamic and supportive work environment.

  • Senior Engineering Leader

    4 days ago

    Ghaziabad, Uttar Pradesh, India beBeeReliability Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Title: Senior Engineering Leader Role Overview: We are seeking a seasoned engineering leader to join our team as a Senior Engineering Leader.The ideal candidate will have a strong background in software engineering, with experience leading teams and driving technical initiatives.The role involves defining and implementing the SRE strategy, promoting an

  • Data Scientist Leader

    8 hours ago

    Ghaziabad, Uttar Pradesh, India beBeeMachineLearning Full time US$ 1,50,000 - US$ 2,00,000

    Job Title:Data Scientist LeaderWe are seeking a seasoned Data Scientist to lead our machine learning initiatives. As a key member of our team, you will be responsible for developing and optimizing complex models for classification, regression, clustering, and recommendation systems.Key Responsibilities:Develop and implement deep learning architectures using...

  • Data Transformation Leader

    4 days ago

    Ghaziabad, Uttar Pradesh, India beBeeData Full time ₹ 1,00,00,000 - ₹ 1,50,00,000

    **Job Title:** Data Steward LeadWe are seeking a seasoned data management expert to lead our data stewardship efforts. As a key member of the Chief Data Office, you will play a pivotal role in supporting the Global Director of Enterprise & AI Stewardship and Delivery – Engage-to-Consume.This exciting opportunity involves partnering with global, regional,...

  • Senior Data Engineering Leader

    3 days ago

    Ghaziabad, Uttar Pradesh, India beBeeDataEngineering Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Title: Data Engineering LeadAbout the RoleWe are seeking an experienced professional to lead our data engineering team in Ghaziabad, India.This role requires a seasoned executive with expertise in BI and reporting, including enterprise-wide reporting systems.Key ResponsibilitiesDevelop a deep understanding of insurance domain and nuances of UK Specialty...

  • Engineering Education Leader

    1 week ago

    Ghaziabad, Uttar Pradesh, India beBeeDirector Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Role:About UsIILM University is a renowned institution dedicated to delivering quality education.Position OverviewWe are seeking a visionary leader to serve as the Director of our School of Engineering.This is an exceptional opportunity to shape the future of engineering education in India.Key ResponsibilitiesProvide academic and strategic leadership to...

  • Data Driven Business Leader

    5 days ago

    Ghaziabad, Uttar Pradesh, India beBeeBusiness Full time ₹ 25,00,000 - ₹ 40,00,000

    KMK Consulting Inc is a global leader in data analytics and technology consulting empowering leaders across the Life Sciences industries to make better data-driven decisions.We help our clients optimize business strategy and operations by delivering cutting-edge analytics from the broadest set of data sources, combined with deep technical and domain...

  • Senior Engineering Leader

    7 days ago

    Ghaziabad, Uttar Pradesh, India beBeeEngineering Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job DescriptionAs a senior engineering leader, you will oversee a team of talented engineers working on various aspects of our products and infrastructure.You will collaborate closely with cross-functional teams to drive innovation and growth. Additionally, you will work with other leaders to develop organizational structures and processes that support our...

  • Software Engineering Leader

    3 days ago

    Ghaziabad, Uttar Pradesh, India beBeeEngineering Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Lead Software Engineers to SuccessJoin a collaborative and flat company culture where human beings of all backgrounds can thrive.As an Engineering Manager, you will lead a small group of engineers working on a particular facet of our products and infrastructure across the stack. You will be working closely with other stakeholders to help us achieve our...

  • Chief Data Insights Leader

    4 days ago

    Ghaziabad, Uttar Pradesh, India beBeeDataInsights Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job SummaryWe are seeking a Chief Data Insights Leader to spearhead end-to-end initiatives, drive business value, and support pre-sales activities.About the RoleThe successful candidate will be responsible for leading business-focused data science projects from strategy to operations. This includes analyzing and interpreting findings, drawing conclusions and...

  • Field Engineering Project Leader

    2 weeks ago

    Ghaziabad, Uttar Pradesh, India beBeeProjectManagement Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    As a seasoned engineering leader, you will oversee the Product Introduction Management organization and provide field engineering guidance to the projects PI team.Key ResponsibilitiesCollaborate with various stakeholders to troubleshoot and resolve technical/quality issues.Liaise with internal units, customer site teams, and external suppliers for seamless...