Senior Big Data Solutions Developer

4 days ago

Ghaziabad, Uttar Pradesh, India beBeeDataEngineering Full time ₹ 30,00,000 - ₹ 40,00,000

Job Title: Big Data Engineer

We are seeking an experienced professional with strong expertise in big data engineering to join our team.

  • Design and develop large-scale data pipelines and distributed data processing systems.
  • Work extensively with Scala, Spark (PySpark), and Python for data processing and transformation.
  • Develop and integrate streaming solutions using Apache Kafka and orchestration tools like Airflow.
  • Write efficient queries and perform data analysis using Jupyter Notebooks and SQL.
  • Collaborate with cross-functional teams to design scalable cloud-based data architectures.
  • Ensure delivery of high-quality code through code reviews, performance tuning, and best practices.
  • Build monitoring and alerting systems leveraging Splunk or equivalent tools.
  • Participate in CI/CD workflows using Git, Jenkins, and other DevOps tools.
  • Contribute to product development with a focus on scalability, maintainability, and performance.

Mandatory Skills:

  • Scala – Minimum 3+ years of hands-on experience.
  • Strong expertise in Spark (PySpark) and Python.
  • Hands-on experience with Apache Kafka.
  • Knowledge of NiFi / Airflow for orchestration.
  • Strong experience in Distributed Data Systems (5+ years).
  • Proficiency in SQL and query optimization.
  • Good understanding of Cloud Architecture.

Preferred Skills:

  • Exposure to messaging technologies like Apache Kafka or equivalent.
  • Experience in designing intuitive, responsive UIs for data analytics visualization.
  • Familiarity with Splunk or other monitoring/alerting solutions.
  • Hands-on experience with CI/CD tools (Git, Jenkins).
  • Strong grasp of software engineering concepts, data modeling, and optimization techniques.

  • Leading Big Data Architectures

    4 days ago

    Ghaziabad, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job OverviewThe role of Senior Data Engineer (Lead) is responsible for leading a team of big data engineers in developing architectures that meet client and business needs. Key responsibilities include providing technical leadership, guiding the team, and ensuring timely delivery of projects.This position requires close collaboration with clients and team...

  • Senior Big Data Developer Position

    2 days ago

    Ghaziabad, Uttar Pradesh, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Big Data DeveloperWe are seeking a skilled Big Data Developer to assume this role. The ideal candidate will have a strong background in big data technologies, including Hadoop, Spark, and Hive.Main Responsibilities:Data Processing: Design, develop, and maintain efficient data pipelines for ingestion, transformation, and storage of large-scale...

  • Big Data Specialist

    4 days ago

    Ghaziabad, Uttar Pradesh, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

    Big Data ExpertWelcome to a unique career opportunity in the field of Big Data!With years of experience spanning 6-12 years, you will have the chance to work on diverse projects, leveraging your skills in data analysis and interpretation.Our ideal candidate will be based in Pune, Mumbai, or Chennai, with a notice period ranging from 0-45 days.Job...

  • Senior Business Intelligence and Data Solutions Architect

    2 days ago

    Ghaziabad, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    The Senior Business Intelligence and Data Engineer plays a crucial role in designing, developing and delivering business intelligence and data solutions to drive organizational success.Key ResponsibilitiesDesigns and implements robust data architectures, seamless data integrations and scalable data warehousing systems to provide accurate and timely...

  • Oil Industry Big Data Engineer

    4 days ago

    Ghaziabad, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 1,00,00,000 - ₹ 2,00,00,000

    Job OpeningWe are seeking a skilled Data Engineer to join our team.The ideal candidate will have extensive experience in designing, developing, and maintaining scalable data pipelines using AWS cloud services.Ingest, process, and store structured/unstructured data from multiple sources (IoT devices, sensors, ERP systems, drilling logs, production data,...

  • Senior Data Engineer

    6 days ago

    Ghaziabad, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Title: Senior Data EngineerWe are seeking a seasoned Senior Data Engineer to join our team. As a key member of our data engineering group, you will design, develop, and maintain large-scale data pipelines and ETL processes on Databricks.The ideal candidate will have 7+ years of experience in Data Engineering and a proven track record of delivering...

  • Unlock Your Potential as a Senior Data Integration Specialist

    5 days ago

    Ghaziabad, Uttar Pradesh, India beBeeDataSpecialist Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Senior Data Integration SpecialistRole Overview:We are seeking a seasoned Senior Data Integration Specialist to lead our data engineering initiatives. As a key member of our team, you will be responsible for architecting and implementing end-to-end data pipelines and integration solutions for varied structured and unstructured data sources and targets.The...

  • Senior Big Data Developer

    6 days ago

    Ghaziabad, Uttar Pradesh, India beBeeDataArchitect Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job Title: Enterprise Data ArchitectThis role involves building high-performance data pipelines, collaborating with data scientists and stakeholders to deliver end-to-end solutions.Key Responsibilities:Design and develop scalable data architectures and ETL workflows.Manage and process large datasets using Spark, PySpark, and SQL.Develop and maintain...

  • Senior Big Data Specialist

    3 days ago

    Ghaziabad, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 1,21,18,721 - ₹ 2,01,14,439

    Data Engineering RoleWe are seeking skilled professionals to contribute to our data infrastructure and support customer experience initiatives. As a Data Engineer at our organization, you will play a critical role in designing, implementing, and maintaining scalable data solutions.Design, develop, and maintain robust data pipelines and ETL processes to...

  • Senior Data Solutions Developer

    3 days ago

    Ghaziabad, Uttar Pradesh, India beBeeDatabase Full time ₹ 10,00,000 - ₹ 15,00,000

    We are seeking a skilled Database Specialist to join our team.Job SummaryThe ideal candidate will have hands-on experience in developing, implementing and maintaining data integration solutions using SSIS packages, SQL Server Job creation, Stored Procedure troubleshooting, Views, and query performance tuning in Microsoft SQL Server.Key...