Data Engineering Lead

4 days ago

Kanpur, Uttar Pradesh, India beBeeDatabaseEngineering Full time ₹ 25,00,000 - ₹ 40,00,000

We are seeking an experienced Data Engineering Lead to drive the development and implementation of our data infrastructure.

Job Description

The Data Engineering Lead will be responsible for designing, building, and maintaining scalable data systems that support our AI and ML initiatives. This includes:

  • Designing and implementing database schemas, structures, and systems optimized for large-scale data ingestion, storage, and retrieval in a data-intensive environment.
  • Collaborating with cross-functional teams (including AI/ML engineers, data scientists, and software developers) to integrate databases with ML/AI workflows, ensuring efficient data flow for model training, inference, and real-time analytics.
  • Developing and maintaining data pipelines, ETL processes, and data lakes to support AI-driven automation, reconciliation, and predictive modeling.
Required Skills and Qualifications

To be successful as a Data Engineering Lead, you will need:

  • Bachelor's or Master's degree in Computer Science, Information Technology, Data Engineering, or a related field.
  • 7+ years of experience in database architecture and design, with a proven track record in building scalable systems for data-heavy applications.
  • Strong proficiency in relational databases (e.g., PostgreSQL, MySQL, Oracle) and NoSQL databases (e.g., MongoDB, Cassandra, Redis).
  • Hands-on experience with cloud-based database services (e.g., AWS RDS, Aurora, DynamoDB; Azure SQL Database; Google Cloud Spanner, BigQuery).
  • Solid understanding of big data technologies (e.g., Hadoop, Spark, Kafka) and data warehousing solutions (e.g., Snowflake, Redshift).
  • Demonstrated experience supporting AI/ML development, including integration with frameworks like TensorFlow, PyTorch, or scikit-learn, and handling datasets for model training.
  • Proficiency in programming languages such as Python, SQL, Java, or Scala for scripting, automation, and data manipulation.
  • Knowledge of data governance, ETL tools (e.g., Apache Airflow, Talend), and API integrations for AI-enhanced systems.
  • Excellent problem-solving skills and the ability to work in a fast-paced, agile environment.
Benefits

As a Data Engineering Lead, you will have the opportunity to work on cutting-edge projects and collaborate with a talented team of engineers and data scientists. You will also receive:

  • Competitive salary and benefits package.
  • Opportunities for professional growth and development.
  • A dynamic and inclusive work environment.
Others

This role offers a unique opportunity to make a significant impact on our organization's data strategy and contribute to the development of innovative AI and ML solutions.

  • Senior Data Engineering Lead

    21 hours ago

    Kanpur, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job DescriptionWe seek an experienced data engineer to lead the design and development of large-scale data processing systems that enable advanced analytics and business intelligence.As a senior data engineer, you will be responsible for architecting and implementing scalable and robust data pipelines that collect, process, and store large volumes of...

  • Lead Azure Data Engineering Expert

    21 hours ago

    Kanpur, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job Title: Lead Azure Data Engineer\This is an opportunity to join our organization as a highly skilled Lead Data Engineer with expertise in Azure and Databricks. The role requires hands-on technical skills, strong communication skills, and the ability to work in a fast-paced environment.\Key Responsibilities:\\Design and develop data pipelines using Azure...

  • Data Engineer

    2 weeks ago

    Kanpur, Uttar Pradesh, India Natlov Technologies Pvt Ltd Full time

    We are looking for a skilled Data Engineer with expertise in AWS services and strong programming skills.Key Responsibilities:Build and maintain data pipelines and workflows using AWS services (Lambda, S3, DynamoDB, Glue, SageMaker).Develop and deploy solutions leveraging Python and Docker.Work on image processing tasks using libraries such as OpenCV (CV2),...

  • Data Engineer

    1 day ago

    Kanpur, Uttar Pradesh, India Denave Full time

    Job ResponsibilitiesDesign, build & maintain scalable data pipelines for ingestion, processing & storage.Collaborate with data scientists, analysts, and product teams to deliver high-quality data solutions.Optimize data systems for performance, reliability, scalability, and cost-efficiency.Implement data quality checks ensuring accuracy, completeness, and...

  • Lead Data Architect

    24 hours ago

    Kanpur, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 22,00,000

    A Senior Data Engineer is responsible for developing and maintaining efficient data pipelines using FiveTran, DBT Cloud, and custom frameworks. The ideal candidate will have experience in ETL development, Snowflake, and data pipeline tools.Key ResponsibilitiesDeveloping and Maintaining ETL Pipelines: Design, develop, and maintain efficient ETL pipelines to...

  • Data Architect and Engineer

    21 hours ago

    Kanpur, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Senior Data Engineer NeededWe're looking for a highly skilled data engineer to join our team.Hands-on expertise in Python and PySpark is essential.5+ years of experience in data engineering with a focus on big data, telemetry, and streaming analytics.The ideal candidate will have strong business acumen, excellent communication skills, and the ability to work...

  • AWS Data Engineer

    1 day ago

    Kanpur, Uttar Pradesh, India Coforge Full time

    Role - AWS Data EngineerSkills - AWS & PySparkJob Locations - Pune, Greater Noida & HyderabadExperience - 6+ years We at Coforge are hiring AWS Data Engineers with the following skill-set:Design, develop, and maintain robust ETL/ELT pipelines using tools like Apache Spark, Airflow, or similar.Build and optimize data architectures (data lakes, data...

  • Expert Data Engineer Wanted

    3 days ago

    Kanpur, Uttar Pradesh, India beBeeDataStrategist Full time ₹ 15,00,000 - ₹ 25,00,000

    Lead Data Strategist OpportunityAbout the RoleWe're seeking an experienced Lead Data Strategist to join our team and drive business growth through data-driven decision making. As a key member of our analytics department, you will be responsible for creating actionable insights that inform our product development roadmap.Key Responsibilities:Design and...

  • Senior Lead Engineer T500-19678

    1 week ago

    Kanpur, Uttar Pradesh, India REA Cyber City Full time

    About REA Group: In 1995, in a garage in Melbourne, Australia, REA Group was born from a simple question: "Can we change the way the world experiences property?" Could we? Yes. Are we done? Never. Fast forward 30 years, REA Group is a market leader in online real estate in three continents and continuing to grow rapidly across the globe. The secret to our...

  • Hot Tapping Engineer

    1 day ago

    Kanpur, Uttar Pradesh, India On Stream Engineering Services Full time

    Company DescriptionOn Stream Engineering Services is a leading service provider for hot tapping and pipeline isolation to all major oil and gas companies in India. Additionally, we manufacture hot tapping split tee fittings for pipelines. Our company is dedicated to delivering reliable and innovative solutions to meet the needs of our clients in the oil and...