
Building Scalable Data Pipelines
13 hours ago
Dear candidate, we are looking for a skilled data engineer to join our team. We are seeking an experienced individual with expertise in building scalable data pipelines using Apache Spark, PySpark, SQL, and Python.
Key Responsibilities:
- Design and develop robust ETL/ELT pipelines on AWS using Spark and PySpark
- Optimize large-scale data processing workflows for performance and reliability
- Work with AWS services such as Glue, EMR, S3, Lambda, and Redshift
- Ensure data quality, governance, and security across all pipelines
Required Qualifications:
- 6+ years of experience in data engineering
- Strong proficiency in Spark, PySpark, SQL, and Python
- Hands-on experience with AWS data services
- Solid understanding of distributed computing and data architecture
- Excellent problem-solving and communication skills
- Experience with CI/CD for data pipelines
- Familiarity with data lake and data warehouse architectures
The ideal candidate will have deep knowledge of big data technologies and excellent problem-solving skills. If you have any questions or need further clarification, please let us know.
To apply, kindly revert this email with your details in the below format:
Name
Contact Number
Email ID
Current Location
Preferred Location
Total Experience
Relevant Experience
Current Organisation
Expected CTC
Regards,
Durga Karunakaran,HCL Technologies Ltd.
-
Building Scalable Data Pipelines
3 days ago
Kottayam, Kerala, India beBeeDataEngineer Full time ₹ 1,00,00,000 - ₹ 1,50,00,000As a Data Integration Specialist, you will have the opportunity to design and build robust data pipelines for processing channel activity data from multiple sources. This role requires strong knowledge of AWS, Python, and experience in handling data from various sources such as Hadoop and Terradata.Key Responsibilities:Design, build, and maintain scalable...
-
Building Scalable Data Pipelines
7 days ago
Kottayam, Kerala, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 20,00,000Job Title: Data EngineerAs a data engineer, you will play a crucial role in building and optimizing data pipelines, ensuring data is clean, secure, and accessible for analytics and operations.Key Responsibilities:Design and create scalable data pipelines and architectures.Work with Azure Cloud, SQL Server, ClickHouse, and MongoDB for data modeling, ETL, and...
-
Building Scalable Data Infrastructure
1 week ago
Kottayam, Kerala, India beBeeDataEngineer Full time ₹ 1,80,00,000 - ₹ 2,10,00,000Job Title:As a senior data engineer, you will design and build scalable data pipelines to support real-time clinical workflows.Key Responsibilities:Design event-driven data pipelines that integrate with EHR/EMR systems using standards like FHIR and HL7.Develop reliable systems to ingest, track, and update clinical events in real-time.Ensure high-quality,...
-
Data Pipeline Architect
3 days ago
Kottayam, Kerala, India beBeeDataEngineering Full time ₹ 1,20,00,000 - ₹ 2,00,00,000Job Title: Data Engineering Professional">">Job Description">The role of a Data Engineer is to design, build, and maintain large-scale data systems that support business operations. This includes developing and deploying data pipelines, implementing data warehouses and lakes, and ensuring data quality and integrity.">As a Data Engineer, you will work closely...
-
Building Scalable Systems
7 days ago
Kottayam, Kerala, India beBeeBackend Full time ₹ 1,20,00,000 - ₹ 2,00,00,000Senior Backend EngineerWe are seeking a highly skilled Senior Backend Engineer to join our high-impact engineering team. As a key member of the team, you will be responsible for designing, developing, and maintaining scalable backend systems and microservices.Key Responsibilities:Design and develop robust backend systems that meet the highest standards of...
-
Senior Technical Architect
1 week ago
Kottayam, Kerala, India beBeeTechnical Full time ₹ 1,50,00,000 - ₹ 2,00,00,000Job DescriptionWe are seeking an accomplished technical professional to spearhead the development of scalable data pipelines and enhance our platform architecture.Design and implement a shared library/SDK for ingestion, parsing, validation, enrichment, and publishing of data.Create standardized configuration, packaging, versioning, CI/CD, and documentation...
-
Building Scalable Big Data Platforms
7 days ago
Kottayam, Kerala, India beBeeTechnical Full time ₹ 20,00,000 - ₹ 30,00,000Big Data Platform EngineerSigmoid empowers enterprises to make data-driven decisions by integrating advanced data engineering with AI consulting. We collaborate with leading organizations across sectors such as CPG-retail, BFSI, life sciences, manufacturing, and more to solve complex business challenges.As a Technical Lead, you will build a highly scalable...
-
Senior Data Pipeline Architect
2 days ago
Kottayam, Kerala, India beBeeDataEngineer Full time ₹ 1,80,00,000 - ₹ 2,10,00,000About the RoleWe are seeking a seasoned data engineer to lead our analytics team and leverage expertise in log-level data handling and modern BI tools.The ideal candidate will have a strong track record of building scalable data pipelines, developing analytics strategies, and mentoring analysts to ensure quality delivery and technical upskilling.Design and...
-
Data Pipeline Architect
2 days ago
Kottayam, Kerala, India beBeeDataEngineer Full time ₹ 80,00,000 - ₹ 1,50,00,000About the JobElevate your career with a challenging data-driven role at a global leading manufacturer.Design and develop scalable pipelines to efficiently process transform data using SparkDevelop a robust framework for generating PDF reports using Python SparkUtilize Snowflake Spark SQL to perform aggregations on high volumes of dataKey...
-
Building Scalable Financial Infrastructure
2 weeks ago
Kottayam, Kerala, India beBeeBackend Full time ₹ 1,20,00,000 - ₹ 2,00,00,000Senior Backend EngineerBuild the backbone of our infrastructure by designing scalable, secure systems that handle mission-critical financial flows. This role involves architecting and implementing core payment processing engines, developing reliable and scalable financial systems for global operations, building integration layers with banking partners and an...