Sr. Data Engineer

7 days ago

Hubli, Karnataka, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

Sr. Data Engineer

Insight Global is looking for a highly skilled Sr. Data Engineer to work remotely in Gurgaon, India.

This role involves designing and implementing data pipelines, orchestrating workflows, processing data, managing datasets, and integrating with various APIs and CI/CD Pipelines.

The ideal candidate will have experience with Big Query, Pyspark, Dataflows, Dataproc, ETL, Apache Airflow, Java, Python, and other related technologies.

We are seeking a strong professional who can troubleshoot issues and create documentation for all data components that meet the needs of customer-facing applications, business applications, internal user applications, and business intelligence platforms.

Key Responsibilities:

  • Data Pipeline Design and Implementation: Design and implement data pipelines to extract, transform, and load data from various sources into Big Query.
  • Workload Automation: Automate workflows using Apache Airflow to ensure efficient processing of data.
  • Data Management: Manage datasets, integrate with APIs, and maintain data quality.
  • Technical Troubleshooting: Troubleshoot technical issues and resolve problems promptly.
  • Documentation: Create comprehensive documentation for data components.

Requirements:

  • At least 6+ years of experience in Data Engineering with NOT Big Data.
  • Strong knowledge of Big Query, Pyspark, Dataflows, Dataproc, ETL, Apache Airflow, Java, and Python.
  • Experience with workload automation, data management, and technical troubleshooting.
  • MUST have previous financial or banking experience.

Benefits:

This role offers an exciting opportunity to work on a large financial institution's modernization project. The successful candidate will be responsible for designing and implementing data pipelines, orchestrating workflows, processing data, managing datasets, and integrating with various APIs and CI/CD Pipelines.

  • Sr. Software Engineer

    2 weeks ago

    Hubli, Karnataka, India beBeeSystemManagement Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Title:Sr. Software Engineer - System Management Expert

  • Senior Data Engineering Leader

    2 weeks ago

    Hubli, Karnataka, India beBeeDataEngineer Full time ₹ 1,80,00,000 - ₹ 2,10,00,000

    Job DescriptionWe are seeking a highly skilled and accomplished Data Engineer to lead our Data Warehouse team.The ideal candidate will have 10+ years of experience in software development, with a focus on backend and data engineering.They should possess strong leadership skills, including the ability to lead a team of Sr. Data Engineers and communicate...

  • Sr. Marine Infrastructure Engineer

    2 weeks ago

    Hubli, Karnataka, India beBeeStructuralEngineering Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    We are seeking a highly skilled Sr. Marine Infrastructure Engineer to lead the design and management of complex port projects. With over 10 years of experience in structural engineering, this individual will oversee the development of key structural components, including breakwaters, jetties, quays, docks, and seawalls.The ideal candidate will have a strong...

  • Ai Security Engineer

    2 weeks ago

    Hubli, Karnataka, India NTT DATA Full time

    Req ID 338875 NTT DATA strives to hire exceptional innovative and passionate individuals who want to grow with us If you want to be part of an inclusive adaptable and forward-thinking organization apply now We are currently seeking a AI Security Engineer - Shared Security Services Engineering to join our team in Banaglore Karn taka IN-KA India ...

  • # Lead Production Excellence as Sr. Production Manager

    1 week ago

    Hubli, Karnataka, India beBeeProduction Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Title">Sr. Production Manager Job Summary:We are seeking an accomplished Sr. Production Manager to lead our production team in achieving operational excellence. The successful candidate will possess exceptional leadership skills, a deep understanding of production techniques, and the ability to drive strategic initiatives aligned with business...

  • Senior Data Engineer

    1 week ago

    Hubli, Karnataka, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000

    Key Data Engineer PositionThis is a crucial data engineer role for an organization. The ideal candidate will have a deep understanding of data engineering principles and be able to apply them to real-world problems.The successful applicant will design and develop data pipelines using Python and cloud-based tools, implement data warehousing and ETL solutions,...

  • Data Engineering Specialist

    7 days ago

    Hubli, Karnataka, India beBeeDataEngineer Full time ₹ 25,00,000 - ₹ 35,00,000

    **Job Title:** Data Engineering SpecialistWe are looking for a highly skilled engineer to join our data engineering team. The ideal candidate will have a proven track record in building, scaling, and optimizing big data pipelines, and hands-on experience in distributed data systems and cloud-based solutions.**Key Responsibilities:Design, develop, and...

  • Strategic Data Analytics Leader

    2 weeks ago

    Hubli, Karnataka, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    Lead Oracle Demantra ConsultantDeliver end-to-end implementation and support of Oracle Demantra modules including Demand Management, Predictive Trade Planning, and Deductions & Settlement Management.Design and configure Demantra workflows, forecast trees, and engine tuning based on demand data.Provide expert-level troubleshooting and performance optimization...

  • Data Engineering Specialist

    1 week ago

    Hubli, Karnataka, India beBeeDataEngineer Full time ₹ 24,00,000 - ₹ 40,00,000

    Job Title: Data Engineering SpecialistWe are seeking a seasoned data engineering specialist to lead our organization's data warehousing, big data, and data analytics initiatives.Total years of experience: 9+ Years required for this position.The ideal candidate should have extensive skills and success in the implementation of technology projects within a...

  • Data Engineering Specialist

    4 days ago

    Hubli, Karnataka, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 22,00,000

    Job Title: Data Engineering SpecialistJob Description:We are seeking an experienced Data Engineer with hands-on expertise in Python and Pyspark to join our team. As a key member, you will be responsible for implementing a data-driven solution for a large retailer.Required Skills & Qualifications:5+ years of experience as a Data EngineerExpertise in Python,...