Current jobs related to Data Pipeline Specialist - Vadodara, Gujarat - beBeeDataPipeline


  • Vadodara, Gujarat, India beBeeQuality Full time ₹ 12,00,000 - ₹ 18,00,000

    ETL Specialist: Data Pipeline Quality AssuranceWe are seeking a skilled ETL specialist to ensure the integrity and quality of our data pipelines.Key Responsibilities:With extensive experience in QA with automation, you will identify and report defects in our ETL processes.In an agile setting, you will work closely with cross-functional teams to guarantee...


  • Vadodara, Gujarat, India beBeeDataFlow Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Title: Data Flow SpecialistA skilled professional is required to build and manage Data Lakes, Data Warehouses, and Data Pipelines using Oracle Data Flow or Apache Spark (PySpark). The ideal candidate will have a solid understanding of data patterns, Python, and SQL.The successful candidate will be proficient in orchestrating data workflows, ensuring...


  • Vadodara, Gujarat, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Big Data EngineerWe are seeking a highly skilled Big Data Engineer to join our team and support data-driven initiatives. This role involves building scalable pipelines, working with streaming data, and collaborating with data scientists and business stakeholders to deliver high-quality solutions.Key Responsibilities:Design, build, and optimize data pipelines...


  • Vadodara, Gujarat, India beBeeDataEngineering Full time ₹ 15,00,000 - ₹ 20,00,000

    Data Engineer OpportunityUnlock business potential by designing and developing scalable data pipelines using cloud technologies.Main Responsibilities:Design and develop data pipelines using Glue, Python, EMR/Spark, and Kafka/Kinesis streaming.Develop relational databases with a preference for Aurora Postgres.Write complex SQL queries and stored...


  • Vadodara, Gujarat, India beBeePipeline Full time ₹ 8,00,000 - ₹ 13,00,000

    Job Title: Data Pipeline ArchitectAre you an experienced data professional looking to take your career to the next level? We are seeking a skilled Data Pipeline Architect to join our team.Key Responsibilities:Design, develop, and optimize complex data pipelines for integrating multiple sources into Databricks.Implement and maintain continuous...

  • Senior Data Engineer

    2 weeks ago


    Vadodara, Gujarat, India beBeeDataEngineering Full time ₹ 15,00,000 - ₹ 20,25,000

    Job Title: Data Engineering SpecialistA challenging role for an experienced professional to design and implement scalable data pipelines using Microsoft Fabric, including Dataflows Gen2, Lakehouse, Notebooks, and SQL endpoints.We are looking for a skilled expert with hands-on experience in Azure Synapse, Microsoft Fabric, Azure Data Factory, Azure Storage,...


  • Vadodara, Gujarat, India beBeePipeline Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Pipeline Stress Engineer SpecialistJob Description:As a highly skilled Pipeline Stress Engineer, you will be responsible for designing and analyzing pipeline systems to ensure safe and efficient operation. You will work closely with cross-functional teams to identify potential issues and develop solutions to mitigate risks.Required Skills and...


  • Vadodara, Gujarat, India beBeeDataScientist Full time ₹ 18,00,000 - ₹ 25,00,000

    ETL Data ArchitectWe are seeking a seasoned ETL Developer to lead the design and implementation of scalable data pipelines using IBM DataStage, AWS Glue, and Snowflake.Design, develop, and maintain efficient data flows leveraging best practices for schema design, partitioning, and transformation logic.Collaborate with cross-functional teams to ensure timely...


  • Vadodara, Gujarat, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 20,10,000

    Key Engineering RoleA highly skilled data engineer is sought to design and build large-scale data pipelines using Google Cloud Platform.Develop, construct, test, and maintain data acquisition pipelines for structured and unstructured data using tools like Python, Data Flow, DataStream, CDC, and BigQuery.Build complex datasets based on business requirements...


  • Vadodara, Gujarat, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 1,80,00,000

    Data Engineer RoleCodeVyasa is seeking a seasoned Data Engineer to join our team of rockstar developers. This role requires a minimum of 4+ years of experience in designing, developing, and maintaining data pipelines and ETL processes using AWS services.The ideal candidate will have hands-on experience with AWS cloud services (S3, Lambda, EC2, RDS, Glue,...

Data Pipeline Specialist

2 weeks ago


Vadodara, Gujarat, India beBeeDataPipeline Full time ₹ 50,00,000 - ₹ 1,00,00,000
Join a Cutting-Edge Team as a Data Pipeline Specialist

Position: Trainee Engineer with a Focus on Data Automation and Analytics

Key Responsibilities

  • Collaborate in designing and implementing data pipelines and automation scripts
  • Support the development of analytical algorithms under guidance from experienced professionals
  • Contribute to the creation and testing of API endpoints
  • Work closely with databases for data extraction and basic queries
  • Assist in documentation and testing processes
  • Learn and apply LLM integration techniques to enhance data insights

Required Skills and Qualifications

  • Fresh graduate or 0-1 year experience in software development, preferably in a team environment
  • Strong foundation in Python programming, including knowledge of data structures and algorithms
  • Basic understanding of SQL and database concepts, with experience working with PostgreSQL/MySQL, Neo4j, and BigQuery
  • Knowledge of Git version control, with experience using Docker and PowerBI
  • Understanding of REST API concepts and software development lifecycle

Preferred Qualifications

  • Academic projects involving data analysis or machine learning, with a focus on Python libraries (Pandas, NumPy)
  • Experience with cloud platforms (AWS or GCP), including familiarity with AWS services or Google Cloud Platform
  • Knowledge of web development frameworks, such as Flask or Django
  • Understanding of software development best practices and agile methodologies

Technical Environment

  • Languages: Python, SQL
  • Cloud: AWS OR Google Cloud Platform
  • Databases: PostgreSQL/MySQL, Neo4j, BigQuery
  • Tools: Git, Docker, PowerBI

Requirements

  • Bachelor's degree in Computer Science, Engineering, Mathematics, or related field
  • Strong analytical and problem-solving skills, with the ability to learn new technologies quickly
  • Good communication and teamwork abilities, with experience working in fast-paced startup environments
  • Ability to adapt to changing project requirements and priorities

Location: This is a remote work opportunity, with flexibility to work from anywhere.