Data Pipeline Engineer

6 days ago


kolkata, India beBeeData Full time

Job Overview:We are seeking an experienced data engineer to design and develop scalable data processing pipelines using AWS and big data technologies.Key Responsibilities:Design and develop efficient data processing pipelines using AWS and big data tools.Implement high-performance data ingestion pipelines with Databricks.Work on ETL, data modeling, integration, and large-scale datasets.Handle multiple file formats (Parquet, AVRO, ORC, CSV, JSON).Collaborate with stakeholders to understand requirements and deliver solutions.Must-Have Skills:AWS Services: EC2, VPC, IAM, S3, Athena, Kinesis, Glue, QuickSight, EMR, Redshift, RDS, Elasticsearch, Lambda, DynamoDB, ElastiCache.Programming: Python, PySpark, Shell scripting, Terraform/CFT.Big Data: Kafka, Spark SQL, DataFrames, Hive.CI/CD tools experience.Strong knowledge of data design and management.Good-to-Have:ECS, ECR, KMS, Kubernetes, Docker.AWS & Databricks certifications.



  • Kolkata, India Ethical Den Full time

    Job Title: Backend / Data EngineerCompany: Ethical Den IndiaLocation: Kolkata (Onsite only)Email for applications: alvira@ethicalden.comWe are looking to hire a Backend/Data Engineer to join our team at Ethical Den India in Kolkata. This is a fully onsite role and is suited to someone who enjoys building stable backend systems and working with real-world...


  • kolkata, India beBeeDataEngineer Full time

    Job OpportunityAs a highly skilled Data Engineer, you will have the chance to contribute to an international data platform, analytics, and cloud engineering teams. Your primary goal will be designing and building scalable, reliable data pipelines using modern data engineering tools and frameworks.You will design and build scalable, reliable data pipelines...


  • kolkata, India beBeeDataEngineering Full time

    Freelance GCP Data Engineer OpportunityWe are seeking a skilled freelancer with expertise in Apache NiFi, SQL, and API integrations to design, implement, and optimize real-time data pipelines for our organization.Design and implement real-time data ingestion pipelines using Apache NiFi for structured and unstructured data.Integrate data pipelines with the...


  • Kolkata, India LTIMindtree Full time

    Greetings from LTIMindtree!We are hiring for below positions and conducting only F2F-Inperson Drive in Kolkata(F2F) and Pune(F2F-Inperson) locations on 29th-Nov-2025(Saturday), and Virtual Drive for Cochin(Video Interview) for only Cochin based candidates on 29th-Nov-2025(Saturday).If interested to apply, please fill the below link with your details and...


  • Kolkata, India Tata Consultancy Services Full time

    Dear Candidate,Greetings from TATA Consultancy Services!!Thank you for expressing your interest in exploring a career possibility with the TCS Family.Hiring For:- Azure Synapse EngineerExperience: 6+Location: Kolkata, BhubaneswarKey Responsibilities:Solution Design & Development:Collaborate with stakeholders to understand data requirements.Design and...


  • kolkata, India beBeeSolutions Full time

    Senior Solutions Architect – Mobility DataOpsThe position of Senior Solutions Architect in our organization plays a pivotal role in the design of our Mobility DataOps ecosystem. This individual defines the foundation of workflows, mapping complex client requirements to scalable solutions that power high-quality operations.Key ResponsibilitiesTranslate...


  • kolkata, India beBeeDataEngineer Full time

    Job Role Overview:We are seeking a seasoned professional to enhance existing data workflows and pipelines using NextFlow. The ideal candidate will possess strong proficiency in NextFlow, with experience in leveraging off-the-shelf machine learning models.This role involves designing and implementing batch processing pipelines in AWS, integrating image...


  • Kolkata, India AIMLEAP Full time

    Data Engineering Manager – Web Crawling & Pipeline ArchitectureExperience: 7 to 12 YearsLocation: Remote / BangaloreEngagement: Full-timePositions: 2Qualification: B.E / B.Tech / M.Tech / MCA / Computer Science / ITIndustry: IT / Data / AI / E-commerce / FinTech / HealthcareNotice Period: ImmediateWhat We Are Looking ForProven experience leading...


  • Kolkata, India Tata Consultancy Services Full time

    TCS hiring!!Role: Azure Data BricksLocation: Kolkata- Walk in DriveInterview Date: 15-Nov-25Experience: 4-12Must Have: - Design and implement scalable, secure, and high-performance data pipelines using Azure-native services and Azure Databricks. - Develop and maintain ETL/ELT processes to ingest, transform, and integrate data from diverse sources. - Build...


  • Kolkata, India Pipeline AI Full time

    Job Title: Managed Services Associate Consultant – Intern Location: Remote, India Type: Internship (6 months, full-time) Target Audience: MBA students (2nd year or pre-final semester) with prior consulting, client delivery, or implementation experience Work Hours: Flexible, with strong overlap to US business hours. Our teams align their schedules around...