Key Data Pipeline Architect
6 days ago
**Job Title: Data Engineer**
">This role presents an exciting opportunity to contribute to the development and maintenance of scalable data pipelines that drive business decisions.
">We are seeking a highly experienced professional with a strong background in Python, Spark, and PySpark. Your expertise in designing and optimizing data pipelines, managing large datasets, and deploying real-time streaming applications will be invaluable to our organization.
">The ideal candidate will collaborate closely with data scientists and product teams to integrate AI/ML models into production. You will also ensure data quality, scalability, and performance in all pipelines, and automate testing and deployment of Spark jobs via CI/CD pipelines.
">To succeed in this role, you will need a Bachelor's/Master's degree in Computer Science, Computer Engineering, or a related field, and minimum 4 years of professional experience as a Data Engineer. You must have hands-on experience with Spark SQL, DataFrames, UDFs, DAG execution, and knowledge of data ingestion tools (Kafka, Flume, Kinesis) and data formats (Parquet, Avro, ORC).
">The successful candidate will be proficient in Airflow/Prefect for scheduling and orchestration, familiar with performance tuning in Spark (partitioning, caching, broadcast joins), and have experience deploying on Databricks, AWS EMR, Azure HDInsight, or GCP Dataproc.
-
Data Pipeline Architect
4 days ago
Rajahmundry, Andhra Pradesh, India beBeeDataPipeline Full time ₹ 20,00,000 - ₹ 25,00,000Key Role: Data Pipeline ArchitectWe are seeking a skilled professional to design and build robust data pipelines that efficiently curate and ingest data.Main Responsibilities:Design, implement, and maintain large-scale data pipelines for seamless data workflows.Collaborate with cross-functional teams to ensure data quality, security, and...
-
Data Pipelines Architect
2 days ago
Rajahmundry, Andhra Pradesh, India beBeeMachineLearning Full time ₹ 1,50,00,000 - ₹ 2,00,00,000Job Title:Data Pipelines ArchitectJob DescriptionWe're evolving into an AI-native platform where intelligent agents predict churn, upsell opportunities and automate member engagement.The right candidate will design and build robust data pipelines to transform raw events into usable features.He/she will also develop and train machine learning models using...
-
Senior Data Engineer(Lead)
3 days ago
Rajahmundry, Andhra Pradesh, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000Lead Data Architect RoleWe are seeking a highly skilled Lead Data Architect to join our team.The ideal candidate will have expertise in designing and developing scalable data pipelines using Apache Spark, AWS Glue, and Azure Data Factory.Strong collaboration skills are essential for working with cross-functional teams to build data lake and data warehouse...
-
Data Architect with Pipeline Expertise
1 week ago
Rajahmundry, Andhra Pradesh, India beBeeInformatica Full time ₹ 18,00,000 - ₹ 25,00,000Job Title: Data Engineer with Informatica DEIWe are seeking an experienced data engineer to design, develop and maintain large-scale data pipelines using Informatica DEI.Key Responsibilities:Design, develop and maintain large-scale data pipelines using Informatica DEI.Collaborate with cross-functional teams to identify business requirements and design data...
-
Data Pipelines Specialist
20 hours ago
Rajahmundry, Andhra Pradesh, India beBeeDataPipelines Full time ₹ 1,50,00,000 - ₹ 2,50,00,000Job Title: Data Pipelines SpecialistAbout the RoleWe are seeking a highly skilled data pipelines specialist to join our team. You will work on designing and building scalable, efficient data pipelines using various technologies including IBM DataStage (on Cloud Pak for Data), AWS Glue, and Snowflake.Key Responsibilities:Design and develop data pipelines that...
-
Data Solutions Architect
4 days ago
Rajahmundry, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 9,00,000 - ₹ 12,00,000Senior Data Solutions ArchitectWe are seeking an experienced Data Engineer to lead our data solutions team in designing, implementing, and maintaining large-scale data pipelines using Azure Data Factory, Apache Kafka, and other relevant technologies.
-
Experienced Data Architect
4 days ago
Rajahmundry, Andhra Pradesh, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000Job Title: Experienced Data ArchitectWe are seeking a senior data expert to join our team. As a key member of the organization, you will be responsible for designing and implementing high-quality data pipelines and systems that power business intelligence, analytics, and operational use cases.This role offers a remote-first opportunity with occasional...
-
Data Pipeline Specialist
4 days ago
Rajahmundry, Andhra Pradesh, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000Senior Test EngineerAs a specialist in ETL and Power BI testing, you will be responsible for ensuring the accuracy, integrity, and performance of data pipelines deployed into cloud environments.The role involves developing and automating comprehensive test cases to validate data flows, transformations, and system behaviors using python scripting and Pytest...
-
Cloud Architect
3 days ago
Rajahmundry, Andhra Pradesh, India beBeeDataOps Full time ₹ 15,00,000 - ₹ 25,00,000Senior AWS Glue DeveloperAs a senior-level developer, you will play a pivotal role in crafting serverless data pipelines using AWS services. Your expertise will empower clients to transition from traditional ETL methodologies to more modern ELT approaches, aligning with industry best practices.You will be responsible for designing and implementing...
-
Big Data Pipeline Specialist
2 days ago
Rajahmundry, Andhra Pradesh, India beBeeDataPipeline Full time ₹ 20,00,000 - ₹ 25,00,000Job Opportunity: Data Pipeline SpecialistOur company seeks a skilled and experienced professional to build and maintain large-scale data pipelines using AWS services.Key Responsibilities:Design, develop, and implement production-level data pipelines that handle structured and unstructured data at terabyte scale.Own the end-to-end ETL/ELT processes, ensuring...
