Data Solutions Specialist

6 days ago

Varanasi, Uttar Pradesh, India beBeeData Full time US$ 1,00,000 - US$ 1,25,000
Job Title: Data Engineer

This is a challenging role for an experienced professional in building scalable data pipelines, working with streaming data, and collaborating with data scientists to deliver high-quality solutions.

The ideal candidate will have a strong background in designing, building, and optimizing data pipelines and ETL workflows using Spark, PySpark, and SQL. They should also be proficient in managing and processing large datasets, building real-time streaming applications, and integrating AI/ML models into production.

Key Responsibilities:

  • Design, build, and optimize data pipelines and ETL workflows.
  • Manage and process large datasets using Spark, PySpark, and SQL.
  • Build and maintain real-time streaming applications with Spark Streaming/Kafka.
  • Collaborate with data scientists to integrate AI/ML models into production.
  • Ensure data quality, scalability, and performance in all pipelines.
  • Deploy and manage Spark workloads on cloud platforms (AWS, Azure, GCP, Databricks).
  • Automate testing and deployment of Spark jobs via CI/CD pipelines.

Requirements:

  • Bachelor's/Master's degree in Computer Science, Computer Engineering, or related field.
  • Minimum 4 years of professional experience as a Data Engineer.
  • Strong expertise in Python, Spark, PySpark.
  • Hands-on experience with Spark SQL, DataFrames, UDFs, DAG execution.
  • Knowledge of data ingestion tools (Kafka, Flume, Kinesis) and data formats (Parquet, Avro, ORC).
  • Proficiency in Airflow/Prefect for scheduling and orchestration.
  • Familiarity with performance tuning in Spark (partitioning, caching, broadcast joins).
  • Experience deploying on Databricks, AWS EMR, Azure HDInsight, or GCP Dataproc.
  • Exposure to testing and CI/CD for data pipelines (pytest, Jenkins, GitHub Actions).

  • Technologist for Data Solutions

    3 days ago

    Varanasi, Uttar Pradesh, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    Unlock Your Career Potential as a Technical SpecialistKey ResponsibilitiesDesign and implement data pipelines using Azure Data Factory to drive business outcomesDevelop scalable data processing solutions within Azure Synapse Analytics to meet client needsDeliver actionable insights through data visualization, driving informed decision-makingRequirements5-7...

  • Senior Data Solutions Specialist

    6 days ago

    Varanasi, Uttar Pradesh, India beBeeDataEngineering Full time ₹ 20,00,000 - ₹ 25,00,000

    Our organization is seeking a skilled Data Architect to lead the design and implementation of scalable data solutions.We require a professional with expertise in Databricks, able to develop data pipelines, architect data lakes, and implement data warehousing solutions using Databricks.The ideal candidate will have experience working with data scientists and...

  • Automation Solutions Specialist

    3 days ago

    Varanasi, Uttar Pradesh, India beBeeAutomation Full time ₹ 20,60,500 - ₹ 25,54,500

    Automation Solutions SpecialistWe are seeking a skilled Automation Solutions Specialist to design, develop, and implement automation solutions for industrial processes.About the Role:The ideal candidate will have a minimum of 8-10 years of experience in automation engineering and commissioning, with expertise in PLC programming, communication protocols, and...

  • Data Solutions Professional

    3 days ago

    Varanasi, Uttar Pradesh, India beBeeAutomation Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Senior Quality Assurance SpecialistWe are seeking a seasoned Senior Quality Assurance Specialist to join our team.About the Role:The successful candidate will be responsible for designing and implementing automated test scripts using Selenium, leveraging scripting languages such as Python, JAVA, C#, JavaScript, Ruby, and PHP.Key Responsibilities:Develop and...

  • Cloud Data Specialist

    4 days ago

    Varanasi, Uttar Pradesh, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

    Cloud Data SpecialistWe are seeking a skilled Data Engineer to join our organization. The successful candidate will work on designing, building and maintaining large-scale data systems using Azure technologies.Key Responsibilities:Design and develop scalable data pipelines using cloud-based services such as Azure Data Factory (ADF) and Azure Databricks...

  • Senior Data Solutions Specialist

    3 days ago

    Varanasi, Uttar Pradesh, India beBeeExpert Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Advanced Data Solutions ExpertWe are seeking a highly skilled expert in advanced data solutions to join our team. As an expert in this field, you will have 6+ years of experience in data science or architecture roles, with a strong background in mathematics and hands-on experience with SQL & NoSQL databases.Key Responsibilities:Implement large-scale AI/ML...

  • Cloud Data Specialist

    2 days ago

    Varanasi, Uttar Pradesh, India beBeeData Full time ₹ 1,80,00,000 - ₹ 2,00,00,000

    Cloud Data SpecialistAbout the Role:As a Cloud Data Specialist, you will collaborate with our elite team to develop and deliver cutting-edge data solutions. You will leverage your expertise in cloud-based technologies to design, implement, and maintain scalable and secure data infrastructure.Key Responsibilities:Collaborate with cross-functional teams to...

  • Data Integration Specialist

    3 days ago

    Varanasi, Uttar Pradesh, India beBeeDataIntegration Full time ₹ 17,50,000 - ₹ 23,50,000

    Job Title: Data Integration SpecialistWe're looking for a skilled professional to join our team as a Data Integration Specialist. This role involves designing, implementing, and maintaining data integration solutions to support business intelligence and analytics initiatives.The ideal candidate will have hands-on experience with ETL tools such as Talend,...

  • Data Architect Specialist

    4 days ago

    Varanasi, Uttar Pradesh, India beBeeDataArchitect Full time US$ 80,000 - US$ 1,40,000

    Data Architect SpecialistAre you a data expert looking for a challenging role in the field of data engineering? Do you have experience with designing and developing scalable data pipelines using Python and AWS services such as S3, Redshift, Lambda, and Glue? If so, we want to hear from you!Key Responsibilities:Data Pipeline Development: Develop and maintain...

  • Supplier Data Specialist

    5 days ago

    Varanasi, Uttar Pradesh, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    As a senior supplier integration specialist, you will be responsible for designing and implementing Supplier360 solutions within Informatica IDMC.You will build and configure pages, business entities, hierarchies, and workflows in Supplier360 to streamline supplier data management.The ideal candidate will have 6–8 years of overall experience in Informatica...