Distinguished Data Engineer

1 day ago

Bareilly, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000
Big Data Developer Job Overview

We are seeking a skilled Big Data Engineer to join our team of data experts. This critical role involves designing, building, and maintaining robust data pipelines for high-volume financial data from various sources.

  • Develop end-to-end data pipelines for stocks, cryptocurrencies, and other financial datasets.
  • Integrate third-party APIs and data feeds into internal systems, ensuring seamless data flow and minimal latency.
  • Create and optimize data ingestion, storage, and transformation workflows (batch and real-time) using Apache Spark, Kafka, and Airflow.
  • Maintain data quality, consistency, and reliability across all pipelines, adhering to strict security protocols and data governance best practices.
  • Collaborate with data scientists, analysts, and backend engineers to provide clean, structured, and scalable datasets that meet business stakeholders' needs.
Required Skills and Qualifications
  • Proven experience as a Big Data Engineer or Data Engineer in financial or crypto domains.
  • Strong expertise in Python, SQL, and programming languages relevant to data engineering.
  • Familiarity with data modeling, data structures, and problem-solving skills to tackle large-scale data challenges.
  • Knowledge of API integrations, real-time streaming data, and databases (relational and NoSQL).
Data Engineering Expertise

In this role, you will utilize your knowledge of distributed data systems and cloud platforms to design, develop, and maintain efficient data pipelines.

  • Design and implement data ingestion, storage, and transformation workflows.
  • Monitor and troubleshoot pipeline performance to ensure optimal results.

  • Data Engineering Specialist

    4 days ago

    Bareilly, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Title: Data Engineering SpecialistWe are seeking a seasoned Data Engineer with extensive experience in designing, developing, and maintaining data pipelines and ETL processes on Databricks. The ideal candidate will have a strong background in big data ecosystems, data modeling, and ETL development.

  • Cloud Data Engineer

    1 day ago

    Bareilly, Uttar Pradesh, India beBeeDataEngineering Full time ₹ 60,00,000 - ₹ 1,50,00,000

    Job Title: Cloud Data EngineerJob Description:We are seeking a highly skilled cloud data engineer to design, develop, and deploy large-scale data pipelines and architectures on Google Cloud Platform (GCP). The ideal candidate will have 3-7 years of experience in working with GCP, Python, PL/SQL, and ETL.Key Responsibilities:Design and develop large-scale...

  • Senior Data Engineer

    2 days ago

    Bareilly, Uttar Pradesh, India beBeeDataEngineering Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Title: Senior Data EngineerJoin us in shaping the future of data engineering with a challenging role that offers opportunities for growth and development.Location: Mumbai, IndiaDesign, develop, and maintain large-scale data pipelines using PySpark.Implement complex business logic using Spark SQL, DataFrame, and RDD APIs.Proficient in Python programming...

  • Experienced Data Engineer

    2 days ago

    Bareilly, Uttar Pradesh, India beBeeData Full time ₹ 18,00,000 - ₹ 25,00,000

    Azure Data Engineer Job Description"> Hello, and welcome to this exciting opportunity for an experienced Azure Data Engineer. We are seeking a skilled professional to join our team and help us drive innovation in the field of data engineering.">"> Key Responsibilities:">">Design, build, and maintain robust data pipelines to curate and ingest data...

  • Data Engineering Leader

    1 day ago

    Bareilly, Uttar Pradesh, India beBeeDataEngineering Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Title:Senior Data Engineer(Lead)DescriptionWe are seeking a highly skilled and experienced Senior Data Engineer to lead our team in designing, developing, and optimizing large-scale data pipelines using Apache Spark, AWS Glue, and Azure Data Factory.Around 6+ years of experience in data engineering or cloud computing data development is required.The...

  • Senior Data Engineer

    4 weeks ago

    Bareilly, Uttar Pradesh, India NEXWARE TECHNOLOGIES PRIVATE LIMITED Full time

    Mandatory Skills : Microsoft Fabric, PySpark, SQL, Data Factory, Power BI, Data Modeling, ETL/ELTExperience : 6-8 YrsPreferred Skills:- Microsoft Fabric: Experience with Lakehouse architecture, notebooks, and warehousing- PySpark: Proficiency in writing PySpark code for data transformation- SQL: Advanced knowledge of SQL for data manipulation and analysis-...

  • Azure Data Engineer

    2 weeks ago

    Bareilly, Uttar Pradesh, India Tata Consultancy Services Full time

    Greetings from Tata Consultancy ServicesWe are hiring Azure Data EngineerPosition: Azure Data EngineerJob Location: ChennaiExperience : 10-14 yearsInterested professionals kindly apply through the link.Must Have:Databricks Certified Associate Developer for Apache Spark (or equivalent)Strong Python/Scala for Spark developmentExperience with Delta Lake and...

  • Data Engineer Lead Role

    1 day ago

    Bareilly, Uttar Pradesh, India beBeeDataEngineering Full time ₹ 20,00,000 - ₹ 25,00,000

    Senior Data Engineering Manager Position AvailableA leading organization seeks an experienced Senior Data Engineering Manager to lead our Data Engineering team.The successful candidate will have a strong background in data engineering, excellent technical skills, and the ability to collaborate with both technical teams and business stakeholders.This is an...

  • Key Data Engineer Position

    2 days ago

    Bareilly, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 10,00,000 - ₹ 12,00,000

    Data Engineering RoleWe are seeking an experienced data engineer to design and develop large-scale data pipelines, analyze complex data sets, and collaborate with cross-functional teams.

  • Strategic Data Engineering Lead

    4 days ago

    Bareilly, Uttar Pradesh, India beBeeEngineering Full time ₹ 25,00,000 - ₹ 30,00,000

    Job DescriptionWe are seeking an experienced Engineering Manager to lead a team of talented data engineers and design scalable data pipelines and analytics platforms.The ideal candidate will have 8+ years of experience in software/data engineering with at least 3 years in a leadership or managerial role.