Effective Data Pipeline Design Specialist

13 hours ago

Anantapur, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000
Job Title: Data Engineer

We are seeking an accomplished Data Engineer to design, develop, and maintain data pipelines for ingestion, transformation, and storage of large-scale data.

Key Responsibilities:

  • Design and Development: Create efficient data pipelines that integrate multiple data sources into a unified platform.
  • Big Data Ecosystems: Work with Big Data ecosystems (Hadoop, Spark, Hive) to process structured and unstructured data.
  • ETL Process Optimization: Develop and optimize ETL processes to ensure seamless integration of data from various sources.
  • SQL Query Writing: Write and optimize SQL queries for data validation, transformation, and analytics.
  • Collaboration: Collaborate with cross-functional teams to understand requirements and deliver high-quality solutions.
  • Scalability and Performance: Optimize data workflows for scalability and performance in production environments.

Required Skills & Qualifications:

  • Big Data Technologies: Proven experience in Big Data technologies (Hadoop, Spark, Hive, HDFS, Kafka, etc.).
  • SQL Expertise: Strong expertise in SQL (query optimization, stored procedures, complex joins).
  • ETL Tools: Hands-on experience with ETL tools/processes (Informatica, Talend, Apache NiFi, Airflow, or custom ETL).
  • Data Warehousing: Deep understanding of Data Warehousing concepts (star schema, snowflake schema, fact/dimension tables).
  • Programming Languages: Proficiency in programming languages like Python, Java, or Scala (for data manipulation).
  • Cloud Platforms: Experience with cloud platforms (AWS Redshift, GCP BigQuery, Azure Synapse, or Snowflake) is a plus.
  • Problem-Solving: Strong problem-solving and debugging skills.

  • Data Pipeline Specialist

    7 hours ago

    Anantapur, Andhra Pradesh, India beBeeData Full time ₹ 80,00,000 - ₹ 1,80,00,000

    Job Title:Data Pipeline SpecialistWe are seeking a highly skilled Data Pipeline Specialist to join our team. As a key member of our data engineering group, you will be responsible for designing, building, and maintaining production-level data pipelines that handle large datasets.Key Responsibilities:Design and develop scalable data pipelines using Python and...

  • Software Architect

    3 hours ago

    Anantapur, Andhra Pradesh, India beBeeData Full time ₹ 10,00,000 - ₹ 15,00,000

    Job Title:Software Architect - Data Pipelines SpecialistWe are seeking an experienced Software Architect - Data Pipelines Specialist to join our team. In this role, you will be responsible for designing and implementing scalable data pipelines using Google Cloud Platform, developing REST APIs, and collaborating with cross-functional teams.About the...

  • Expert Data Pipeline Specialist

    2 days ago

    Anantapur, Andhra Pradesh, India beBeeAzure Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job OpportunityProtecting businesses and organizations from cyber threats is a top priority for any organization.Our data integration and ETL needs are driven by the need to safeguard our clients' sensitive information.Key ResponsibilitiesDesign, build, and maintain data pipelines for extract, transform, and load (ETL) processes.Integrate data from multiple...

  • Cloud Data Pipeline Specialist

    3 days ago

    Anantapur, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Data Engineering Role OverviewWe are seeking an experienced Data Engineer to lead the design, development, and operation of data pipelines on the Azure platform. This is a key position in our organization that requires expertise in data processing, warehousing, and business insights.About the PositionDesign, develop, and maintain complex data pipelines using...

  • Senior Data Pipeline Specialist

    2 days ago

    Anantapur, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Title: ETL Developer – DataStage, AWS, SnowflakeWe are seeking an experienced and skilled ETL Developer to join our data engineering team. The successful candidate will work on designing and developing scalable and efficient data pipelines using IBM DataStage (on Cloud Pak for Data), AWS Glue, and Snowflake.The ideal candidate will have a strong...

  • Scalable Data Pipelines Specialist

    4 days ago

    Anantapur, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 12,00,000 - ₹ 18,00,000

    **Job Title:** Data EngineerJob SummaryWe're seeking a skilled data engineer to build and maintain our analytics backbone, creating scalable data pipelines that fuel real-time insights for our global operations.This role involves turning raw data points into actionable intelligence, driving machine learning models and AI-driven decisions that propel our...

  • Future Data Pipeline Specialist

    10 hours ago

    Anantapur, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 6,00,000 - ₹ 12,00,000

    Job Title:Trainee Engineer A trainee engineer is responsible for assisting in building data pipelines and automation scripts, supporting the implementation of analytical algorithms under guidance, and contributing to documentation and testing processes.Key Responsibilities:Build data pipelines and automation scripts using Python programming languageSupport...

  • Cloud Data Engineer

    3 days ago

    Anantapur, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 30,00,000

    We are seeking a highly skilled data engineer to lead the design and implementation of robust data pipelines using AWS services, Python, and SQL. The ideal candidate will have expertise in cloud-based data engineering and strong proficiency in related technologies.Key ResponsibilitiesDesign and implement scalable and efficient data processing systems using...

  • Senior Data Analyst

    2 days ago

    Anantapur, Andhra Pradesh, India beBeeData Full time ₹ 15,00,000 - ₹ 20,10,000

    Key Role in Data Pipeline DevelopmentAs a Technical Specialist, you will play a key role in designing and implementing data pipelines using Azure Data Factory. With expertise in Data Warehousing and Azure Synapse Analytics, you will create scalable data processing solutions and provide actionable insights through data visualization.Core SkillsWe are seeking...

  • Principal Data Pipeline Developer

    3 days ago

    Anantapur, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 20,10,000

    Job SummaryYou will be responsible for designing and implementing data pipelines using modern DevOps/configuration management tools, focusing on scalability and reliability.Key Responsibilities:Design and implement Continuous Integration/Continuous Deployment (CI/CD) pipelines using GitHub Actions or equivalent tools.Configure and maintain GitHub branch...