
Cloud Data Pipeline Specialist
4 days ago
Job Overview
We are seeking a seasoned Data Processing Engineer to join our data engineering team. The ideal candidate will have strong expertise in Scala, Spark, and Python for building and optimizing large-scale data pipelines.
Key Responsibilities
- Design, develop, and optimize distributed data processing systems.
- Work extensively with Scala, Spark (PySpark), and Python for data processing and transformation.
- Develop streaming solutions using Apache Kafka and orchestration tools like NiFi/Airflow.
- Write efficient queries and perform data analysis using Jupyter Notebooks and SQL.
- Collaborate with cross-functional teams to design scalable cloud-based data architectures.
Required Skills
- Scala: 3+ years of hands-on experience.
- Strong expertise: Spark (PySpark) and Python.
- Apache Kafka: Hands-on experience.
- Distributed Data Systems: Strong experience (5+ years).
- SQL: Proficiency and query optimization.
Preferred Skills
- Messaging Technologies: Exposure to Apache Kafka or equivalent.
- Data Analytics Visualization: Experience designing intuitive UIs.
- Monitoring/Alerting Solutions: Familiarity with Splunk or other solutions.
Bonus Points: Hands-on experience with CI/CD tools (Git, Jenkins) and software engineering concepts.
-
Cloud Data Pipelines Specialist
3 days ago
Cochin, Kerala, India beBeeDataScientist Full time ₹ 1,50,00,000 - ₹ 2,00,00,000Talend ETL Developer Opportunity">Appit Software Inc, a forward-thinking organization, is seeking an accomplished professional to fill the role of Talend ETL Developer with expertise in cloud data pipelines. The ideal candidate will have 8-10 years of experience and possess excellent communication skills.**Key Responsibilities:**- Design and optimize complex...
-
AWS Cloud Data Pipeline Architect
4 days ago
Cochin, Kerala, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000Highly skilled and experienced data engineers are sought after to play a key role in the design, development, and deployment of end-to-end data pipelines on AWS cloud infrastructure using Amazon S3, AWS Glue, AWS Lambda, and Amazon Redshift services.Main Responsibilities:Design and develop scalable data pipelines to support analytics and reporting...
-
Senior Data Pipeline Specialist
5 days ago
Cochin, Kerala, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000Job Role Summary:We are seeking an accomplished Data Pipeline Developer to join our team and spearhead the creation of efficient data ingestion pipelines for integrating multiple sources into Databricks. This pivotal role requires expertise in designing, developing, and optimizing data ingestion processes that prioritize scalability and efficiency.Key...
-
Data Pipeline Lead
6 days ago
Cochin, Kerala, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000Lead Data ArchitectOur team is seeking an accomplished data architect to lead the design and implementation of large-scale data pipelines. As a senior member, you will play a pivotal role in shaping our company's data strategy.Key Responsibilities:Design and implement ETL pipelines using FiveTran, DBT Cloud, and custom frameworksDevelop client-specific data...
-
Senior Data Pipeline Specialist
2 days ago
Cochin, Kerala, India beBeeDataEngineer Full time ₹ 12,00,000 - ₹ 20,00,000Job Summary:We are seeking an experienced Python data engineer to join our organization. As a key member of our data initiatives, you will be responsible for designing and maintaining scalable, reliable data pipelines using Python and orchestration tools.Main Responsibilities:Create robust and scalable data pipelines using Python.Utilize orchestration and...
-
Data Pipeline Engineer
4 days ago
Cochin, Kerala, India beBeeTechnical Full time ₹ 15,00,000 - ₹ 20,00,000Job OverviewWe are seeking a skilled Technical Specialist to assume the role of designing, implementing, and managing data pipelines using Azure Data Factory. The ideal candidate will have 5-7 years of experience in data warehousing and Azure Synapse Analytics.This is a critical position that involves collaborating closely with clients to understand their...
-
Cloud Security Specialist
5 days ago
Cochin, Kerala, India beBeeCloudSecurity Full time ₹ 20,00,000 - ₹ 25,00,000Job OverviewWe are seeking a detail-oriented Cloud Security Specialist to join our security team. This entry-level role is ideal for recent graduates or individuals with up to 1 year of experience in cybersecurity or cloud technologies.The Cloud Security Specialist will support the implementation and monitoring of security measures for cloud-based systems to...
-
Building Scalable Data Pipelines Specialist
6 days ago
Cochin, Kerala, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000Real-time Data Infrastructure EngineerThis is a full-time hybrid role for a skilled professional responsible for building and maintaining large-scale data infrastructures, developing high-performance data processing pipelines using cutting-edge technologies like Apache Kafka, Flink, and Spark.Key Responsibilities:Data Architecture and DesignExtract Transform...
-
Cloud Data Engineer
5 days ago
Cochin, Kerala, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000Job Title: Data Engineer - Cloud Infrastructure SpecialistWe are seeking a skilled Data Engineer to design, build, and maintain automated data pipelines in Azure Databricks, supporting governance and analytics initiatives.Key Responsibilities:Design and deploy robust ETL/ELT pipelines using PySpark, SQL, and Delta Lake for ingesting, transforming, and...
-
Cloud Infrastructure Specialist
2 days ago
Cochin, Kerala, India beBeeInfrastructure Full time ₹ 15,00,000 - ₹ 20,00,000Job Title: Cloud Infrastructure SpecialistWe are seeking an experienced Cloud Infrastructure Specialist to join our team.A cloud infrastructure specialist is responsible for designing, implementing, and managing cloud-based infrastructure components. This includes virtual machines, networks, storage, and databases.The ideal candidate will have strong...