Lead Data Engineer

4 weeks ago

Noida, Uttar Pradesh, India Convegenius Full time

About us :


We are a leading Conversational AI company thats revolutionizing education for millions worldwide. Our knowledge bots are already empowering 35 million users, and we're at the forefront of shaping the future of EdTech in Naya Bharat.

We're creating an omniverse in Conversational AI, where developers collaborate to innovate together.
As part of our team, you'll have a pivotal role in turning complex educational data into practical insights that drive real change.

We're deeply committed to enhancing education for 150 million children in India, partnering with state departments and supporting national initiatives like Vidhya Samiksha Kendra under the National Education Policy 2020. ConveGenius operates across three divisions: ConveGenius Digital uses AI and bots to make systemic improvements, ConveGenius Edu offers Swift PAL tablets and AR-enhanced learning, and ConveGenius Insights leads global research in educational science.

If youre passionate about making a meaningful impact in education, have experience in both business and social sectors, and thrive in fast-paced environments, join us in transforming EdTech for Naya Bharat. Embrace our startup culture, where innovation and determination reshape Indias educational future.

Key Responsibilities :

- Design, develop, and maintain data pipelines and ETL processes to efficiently ingest, transform, and load data from various sources into data warehouses and data lakes.

- Collaborate with data scientists, analysts, and business stakeholders to understand data requirements and design data models that facilitate efficient data retrieval and analysis.

- Optimize data pipeline performance, ensuring scalability, reliability, and data integrity.

- Implement data governance and security measures to ensure compliance with data privacy regulations and protect sensitive information.

- Identify and implement appropriate tools and technologies to enhance data engineering capabilities and automate processes.

- Conduct thorough testing and validation of data pipelines to ensure data accuracy and quality.

- Monitor and troubleshoot data pipelines to identify and resolve issues, ensuring minimal downtime.

- Develop and maintain documentation, including data flow diagrams, technical specifications, and user guides.

Qualifications :

- Bachelor's degree in Computer Science, Engineering, or a related field.

- A master's degree is a plus.

- Proven experience as a Data Engineer or in a similar role, with a strong understanding of data engineering concepts, practices, and tools.

- Proficiency in programming languages such as Python, Java, or Scala, and experience with data manipulation and transformation frameworks/libraries (e.g., Apache Spark, Pandas, SQL).

- Solid understanding of relational databases, data modeling, and SQL queries.

- Experience with distributed computing frameworks, such as Apache Hadoop, Apache Kafka, or Apache Flink.

- Knowledge of cloud platforms (e.g., AWS, Azure, GCP) and experience with cloud-based data engineering services (e.g., Amazon Redshift, Google BigQuery, Azure Data Factory).

- Familiarity with data warehousing concepts and technologies (e.g., dimensional modeling, columnar databases).

What We Offer & Benefits :


At ConveGenius, we believe in creating a supportive and dynamic work environment where you can thrive professionally and personally.

If youre passionate about making a difference in education and enjoy working in a diverse and inclusive setting, ConveGenius is the place for you

- Experience working with a diverse team of professionals located throughout India.

- Be part of an organization that operates in over two-thirds of India's states.

- Play a crucial role in transforming the education sector in India.

- Enjoy the security and peace of mind that comes with health insurance coverage.

- Benefit from a flexible leave policy, including special provisions for period leaves

(ref:hirist.tech)

  • Senior Data Engineer

    4 weeks ago

    Noida, Uttar Pradesh, India A Data Science Company Full time

    Company DescriptionA fast-growing data-science company, serving clients across industries and geographies.Position: Senior Data Engineer (Azure)Experience : 5y to 10yLocation : NOIDAWork Mode : In Office onlyInterview Process : 3 Tech rounds, Fitment round, HR round.Joining : Immediate to 30 daysCTC Offered: Based on skillset and experienceRole...

  • Lead Data Engineer

    4 weeks ago

    Noida, Uttar Pradesh, India SUPERSOURCING TECHNOLOGIES PRIVATE LIMITED Full time

    About the Role:We are looking for an experienced Lead Data Engineer with deep expertise in Big Data technologies, particularly within the Google Cloud Platform (GCP) ecosystem. The ideal candidate should have a strong command of PySpark/Spark, SQL, and Python, and a proven track record in building, optimizing, and managing large- scale data pipelines and...

  • Lead Data Engineering Urgent Search

    4 weeks ago

    Noida, Uttar Pradesh, India Tata Cummins Full time

    Job DescriptionJob Description- Seeking an experienced and motivated Data Engineering Lead tojoin our growing team.- The ideal candidate will have a minimum of 5 years of hands-on experience in data engineering, with a strong focus on Spark.- As a Data Engineering Lead, the candidate will play a pivotal role in designing, developing, and maintaining our...

  • Mid Data Science

    1 hour ago

    Noida, Uttar Pradesh, India NTT DATA Full time

    Req ID 312499 NTT DATA strives to hire exceptional innovative and passionate individuals who want to grow with us If you want to be part of an inclusive adaptable and forward-thinking organization apply now We are currently seeking a Mid Data Science AIML GenAI Lead Engineer to join our team in Noida Uttar Pradesh IN-UP India IN Job...

  • Systems Engineering Specialist

    2 weeks ago

    Noida, Uttar Pradesh, India NTT Data Full time

    Job DescriptionNTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Systems Engineering Specialist to join our team.At NTT DATA, we know that with the right people on board, anything is...

  • Digital Engineering Sr Staff Engineer

    4 weeks ago

    Noida, Uttar Pradesh, India NTT DATA Full time

    Req ID 310926 NTT DATA strives to hire exceptional innovative and passionate individuals who want to grow with us If you want to be part of an inclusive adaptable and forward-thinking organization apply now We are currently seeking a Digital Engineering Sr Staff Engineer to join our team in Noida Uttar Pradesh IN-UP India IN Title ...

  • Devsecops Engineer

    3 weeks ago

    Noida, Uttar Pradesh, India NTT DATA Full time

    Req ID 312238NTT DATA strives to hire exceptional innovative and passionate individuals who want to grow with us If you want to be part of an inclusive adaptable and forward-thinking organization apply now We are currently seeking a DevSecOps Engineer to join our team in Noida Uttar Pradesh IN-UP India IN Application Security AppSec Role1 ...

  • Cisco - Network Engineering Senior Specialist

    3 weeks ago

    Noida, Uttar Pradesh, India NTT DATA Full time

    Req ID 305465 NTT DATA strives to hire exceptional innovative and passionate individuals who want to grow with us If you want to be part of an inclusive adaptable and forward-thinking organization apply now We are currently seeking a Cisco - Network Engineering Senior Specialist to join our team in Noida Uttar Pradesh IN-UP India IN JOB...

  • Senior Cloud Engineer Advisor

    2 weeks ago

    Noida, Uttar Pradesh, India NTT Data Full time

    Job DescriptionReq ID:304573NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Senior Cloud Engineer Advisor to join our team in Noida, Uttar Pradesh (IN-UP), India (IN).Preferred...

  • Lead Cloud Data Engineer

    3 weeks ago

    Noida, Uttar Pradesh, India upGrad Full time

    About the Job :We're hiring an cloud data engineering (preferably Azure) data pipelines and Spark. - Work with Databricks platform using Spark for big data processing and analytics. - Write optimized and efficient code using PySpark, Spark SQL and Python. - Develop and maintain ETL processes using Databricks notebooks and workflows. - Implement and optimize...