Senior Data Engineer

3 weeks ago

Thane, India redBus Full time

redBus.in is India's largest online bus ticketing platform operating across India, SEA & LATAM (Part of GO-MMT group, Nasdaq: MMYT). We have the largest network of bus operators and satisfied customers booking upto 250,000 transactions a day through mobile and desktop channels. With over 300,000+ live routes in multiple continents we host the largest inventory of bus seats from private bus operators and state road transport corporations. We are a true Indian MNC with global presence and operations across India, Singapore, Malaysia, Indonesia, Vietnam, Peru and Colombia. In India, redBus works with 3000 + bus operators with services across 50,000 + routes and a customer base of more than 10 million.


redBus at its heart is about people. As the pioneer in our space, we are passionate about creating amazing experiences for passengers, partners and our people. Energized by a great work environment, where talent is nurtured, innovation is celebrated and challenges are conquered, we journey towards creating fulfilling moments for everyone whose lives we touch. Always striking a balance between getting the job done, while also having fun along the way. So here is to being a Great Place to Work


Key Responsibilities:

Data Infrastructure & Pipeline Development:

  • Design, build, and maintain scalable data and machine learning pipelines to support real-time processing and high-volume data flows. Oversee the entire pipeline lifecycle to ensure efficient data collection, transformation, and integration across platforms.

Pattern Mining & Anomaly Detection:

  • Develop frameworks for pattern mining and anomaly detection within user behavior and transaction data. Continuously monitor and analyze data to identify actionable patterns and anomalies, supporting proactive decision-making.

Workflow Automation:

  • Automate and orchestrate workflows to optimize data movement, transformation, and ML model deployment, ensuring high availability and operational efficiency across data workflows.

Generative AI for Data Insights:

  • Leverage generative AI tools to automate diagnostic summaries, enhance feature engineering, and make data insights accessible to both technical and non-technical users.

ML Model Deployment & Monitoring:

  • Deploy, monitor, and manage machine learning models in production, focusing on performance and accuracy for anomaly detection and pattern recognition. Use monitoring tools to ensure model health and proactively address issues.

Data Warehousing & Real-Time Analytics:

  • Develop and manage robust data warehousing and real-time analytics solutions to support rapid decision-making and effective anomaly detection across the organization.



Educational Qualification:

Bachelor’s or Master’s degree in Computer Science or a related field.


Years of Experience:

3 to 5 years in Big data engineering.


Nature and Scope of Responsibilities:


The ideal candidate will be responsible for developing cutting-edge services for pattern mining and anomaly detection, utilizing billions of user behavior and transaction signals daily. This role involves handling big data, building resilient and stable data engineering pipelines for high-volume processing, and performing data modeling for databases and data warehouses to support scalable solutions. Collaboration with cross-functional teams, including product, business development and engineering, is essential to drive actionable insights and enhance data accessibility. Key responsibilities include automating data workflows, deploying models, and utilizing generative AI tools to enhance data usability for diverse stakeholders.



Must-Have Skills:

  • Expertise in at least two big data and data pipeline technologies, including Apache Kafka, Apache Nifi, and Apache Spark.
  • Strong understanding of data warehousing concepts and database modeling skills , with experience in tools like Apache Iceberg/Hudi and data warehouses like AWS Redshift.
  • Advanced programming skills in Python, Java, and SQL for data engineering and ML workflows.
  • Strong familiarity with AWS cloud services, including RDS, Redshift, Athena, EC2, ECS, Lambda, Glue, and Fargate.
  • Exposure to advanced statistical and machine learning techniques for anomaly detection and pattern recognition.
  • Familiarity with generative AI applications to enhance data insights.



Good-to-Have Skills:

  • Experience in OLAP databases like Apache Druid and ClickHouse.
  • Strong experience with one of the workflow automation and orchestration tools, such as Apache Airflow, Prefect, or Luigi.
  • Knowledge of predictive maintenance for data pipelines.
  • Proficiency in ML lifecycle management and model monitoring using tools such as Amazon SageMaker and MLflow.
  • Knowledge of GCP and Azure services.
  • Knowledge of front-end application development.

  • Data Engineer

    4 weeks ago

    Thane, India Adastra Full time

    Adastra India is a part of Adastra Group. The company was established in 2024 as an extension of Adastra Global Delivery in the APAC region. The company is focused on attracting, upskilling and utilizing local talent for projects delivered by Adastra in Europe and North America. The company has a local office in Pune hiring consultants locally and remotely...

  • Azure Data Engineer

    3 weeks ago

    Thane, India Hexaware Technologies Full time

    Experience: 6-9 yrs Work location: Bangalore/Pune/ChennaiNotice Period: Immediate - 30 days Senior Data Engineer - Azure DatabricksWork timing: UK Shift: 1pm IST to 10PM ISTStrong Experience in Azure DBGood Knowledge in PysparkExperience in SQL ServerExperince in Data MigrationExperience in Cloud Migration ( Azure DB )Good CommunicationFlexibility to work...

  • Mechanical Design Engineer

    2 months ago

    Thane, India Deerns Full time

    Senior Mechanical Engineer Location: Mumbai, India. Working from Thane officeJob Status: PermanentSector: Data Centres, part of Life Sciences & High Tech UnitSalary: Competitive and negotiableJob Title: Senior Mechanical EngineerReport to: Design Project ManagerWe’re experiencing an exciting period of growth and we have opportunities available for a...

  • Data Center Operations Engineer

    1 month ago

    Thane, India search syerngy Full time

    Vacancy for Senior Infrastructure SpecialistWe are seeking an experienced Data Center Operations Engineer to join our team at search syerngy. The ideal candidate will have a strong background in developing Data Center Operations and Support Functions, with a minimum of 10 years of experience. Additionally, the candidate should have at least 4 years of...

  • Data Engineer

    1 week ago

    Thane, India Maestro Technologies, Inc. Full time

    Role Overview:As a Data Engineer, you will be responsible for designing, developing, and maintaining robust data pipelines, ensuring data is easily accessible and actionable for business teams. You will work closely with data scientists, analysts, and other engineers to support data integration and transformation efforts, leveraging GCP services such as...

  • Data Engineer

    2 weeks ago

    Thane, India IntraEdge Full time

    We have an opening for Data Engineer role with a focus on building pipelines, data quality, governance, and transformation using the required tools:Job Title: Data Engineer (DBT & Snowflake specialist)Location: Pune or Remote (immediate Joining or 1 month)Job Type: Full-timeExp Level- 3 To 9 yearsData Engineering, building pipelines, SQL, Informatica Data...

  • Data Engineer

    3 months ago

    Thane, India Deloitte Full time

    Hi, We are looking for Candidates who are having experience as Data Engineer Role.Experience Required: 4+ years.Location: PAN IndiaResponsibilities:Databricks Development: Design, develop, and optimize Databricks workflows and solutions.Python & PySpark: Write, test, and maintain Python and PySpark code for data processing and analytics.SQL Proficiency:...

  • Senior Electrical Engineer – MEP

    6 months ago

    Thane, India Deerns Full time

    We’re experiencing an exciting period of growth, and we have opportunities available for a talented and innovative individual to join our fast-growing office at a senior level and looking to take their career on to the next step. Data Centre design experience is essential, as is a willingness to travel within India and potentially abroad.This is an...

  • Senior site engineer

    7 days ago

    Thane, India Acotech Consultants Full time

    Company DescriptionAcotech Consultants Private Limited (ACPL) is a multidisciplinary technical consultation firm established in 1995. ACPL specializes in Roadway and Bridges, Structures, Architecture Planning, Water and Drainage Distribution Management, and Surveys and Advance Testing. With over 27 years of experience, ACPL offers sustainable solutions for...

  • Senior Site Engineer

    1 week ago

    Thane, India Acotech Consultants Full time

    Company Description Acotech Consultants Private Limited (ACPL) is a multidisciplinary technical consultation firm established in 1995. ACPL specializes in Roadway and Bridges, Structures, Architecture Planning, Water and Drainage Distribution Management, and Surveys and Advance Testing. With over 27 years of experience, ACPL offers sustainable solutions...

  • Senior Site Engineer

    1 week ago

    Thane, India Acotech Consultants Full time

    Company DescriptionAcotech Consultants Private Limited (ACPL) is a multidisciplinary technical consultation firm established in 1995. ACPL specializes in Roadway and Bridges, Structures, Architecture Planning, Water and Drainage Distribution Management, and Surveys and Advance Testing. With over 27 years of experience, ACPL offers sustainable solutions for...

  • Senior Site Engineer

    1 week ago

    Thane, India Acotech Consultants Full time

    Company DescriptionAcotech Consultants Private Limited (ACPL) is a multidisciplinary technical consultation firm established in 1995. ACPL specializes in Roadway and Bridges, Structures, Architecture Planning, Water and Drainage Distribution Management, and Surveys and Advance Testing. With over 27 years of experience, ACPL offers sustainable solutions for...

  • Senior AI Engineer

    1 month ago

    Thane, India Ajna Lens Full time

    AJNA Lens is seeking a highly skilled Senior AI Engineer to lead the development of cutting-edge AI solutions using Computer Vision (CV), Deep Learning (DL), and Machine Learning (ML) methodologies. The ideal candidate will have a deep understanding of data acquisition from hardware sources, sensor fusion, and hands-on experience in implementing and...

  • Azure Data Engineer

    1 month ago

    thane, India Databerry Technologies Pvt Ltd Full time

    As a member of the Data Engineering team, you will:Implement continuous improvements to our data governance practices and implement data quality improvements.Partner with key stakeholders to understand and refine data product requirements.Design and develop reliable data product pipelines that transform data at scale, orchestrated via Azure Data Factory,...

  • Executive - Data Science

    5 months ago

    Thane, India Tata AIA Life Full time

    **Job Description **A Position Overview** **Position Title** Junios Data Engineer - Azure / JDE(A) **Department** IT **Level / Band** **Role Summary**: - Have excellent problem-solving and troubleshooting skills. This also includes the ability to search and find the optimal solutions for a Data Engineering problem. - Have an innovative mindset to...

  • AVP, Data Engineering – SonyLIV

    3 weeks ago

    Thane, India Sony Pictures Networks India Full time

    Drive the Future of Data-Driven Entertainment Are you passionate about working with big data? Do you want to shape the direction of products that impact millions of users daily? If so, we want to connect with you. We’re seeking a leader for our Data Engineering team who will collaborate with Product Managers, Data Scientists, Software Engineers, and ML...

  • KPMG India | Senior Manager-Data Engineer | thane

    1 week ago

    thane, India KPMG India Full time

    About KPMG in India. KPMG entities in India are professional services firm(s). These Indian member firms are affiliated with KPMG International Limited. KPMG was established in India in August 1993. Our professionals leverage the global network of firms, and are conversant with local laws, regulations, markets and competition. KPMG has offices across India...

  • ▷ (High Salary) Senior Site Engineer

    7 days ago

    Thane, India Acotech Consultants Full time

    Company DescriptionAcotech Consultants Private Limited (ACPL) is a multidisciplinary technical consultation firm established in 1995. ACPL specializes in Roadway and Bridges, Structures, Architecture Planning, Water and Drainage Distribution Management, and Surveys and Advance Testing. With over 27 years of experience, ACPL offers sustainable solutions for...

  • Data Center Operations Engineer

    1 month ago

    Thane, India search syerngy Full time

    Data Center Operations EngineerSearch Synergy is seeking a highly skilled Data Center Operations Engineer to join our team. The ideal candidate will have 10+ years of experience in developing Data Center Operations and Support Functions, as well as 4+ years of experience with MS Azure and DC Migration.Key Responsibilities:- Develop and implement tools and...

  • Senior Software Engineer – AI Tooling

    2 months ago

    thane, India Turing Full time

    About the RoleWe are looking for a Senior Software Engineer to take ownership of our AI tooling projects and play a key leadership role within our engineering team. In this position, you will be responsible for delivering medium-sized projects end-to-end, including system architecture, front-end, and back-end development. You will also act as a Tech Lead...