Senior Data Engineer

2 days ago

Kanpur, Uttar Pradesh, India beBeeData Full time ₹ 15,00,000 - ₹ 18,00,000

We are seeking a skilled professional to fill the position of a Talend ETL Developer with expertise in data integration, particularly in Talend Open Studio and cloud-based technologies.

**Job Description:**

The ideal candidate will possess experience working with complex ETL pipelines, debugging, and deployment using TMC. Additionally, they should have hands-on experience with BigQuery, including partitioning, clustering, federated queries, and advanced SQL concepts such as CTEs, arrays, and window functions.

The candidate should also be proficient in Python for ETL scripting, automation, and integration with cloud data pipelines. Furthermore, they should have knowledge of PostgreSQL, including PL/pgSQL functions, triggers, query optimization, and materialized views.

Experience with cloud-based technologies, specifically Google Cloud Platform (GCP), is essential. This includes hands-on experience with Pub/Sub, Dataflow, Dataprep, and Google Cloud Storage. The candidate should also be familiar with version control systems, specifically Git/GitHub workflows with branching, PR reviews, and CI/CD using Jenkins.

**Required Skills and Qualifications:**

- Excellent communication skills

- Expertise in Talend Data Integration: Design & optimize complex ETL pipelines, debugging, and deployment using TMC

- Proficiency in BigQuery: Partitioning, clustering, federated queries, advanced SQL (CTEs, arrays, window functions)

- Experience with Python: ETL scripting, automation, and integration with cloud data pipelines

- Knowledge of PostgreSQL: PL/pgSQL functions, triggers, query optimization, materialized views

- Hands-on experience with Cloud (GCP): Pub/Sub, Dataflow, Dataprep, and Google Cloud Storage

- Version Control: Proficiency in Git/GitHub workflows with branching, PR reviews, and CI/CD using Jenkins

**Benefits:**

- Immediate contractual position

- Remote work option

- South Indian profiles preferred

**Others:**

- Experience with BigQuery ML (regression, classification, forecasting) is a plus

- Familiarity with offline-first data solutions and advanced integration strategies is an advantage

  • Senior Data Engineering Lead

    2 days ago

    Kanpur, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job DescriptionWe seek an experienced data engineer to lead the design and development of large-scale data processing systems that enable advanced analytics and business intelligence.As a senior data engineer, you will be responsible for architecting and implementing scalable and robust data pipelines that collect, process, and store large volumes of...

  • Senior Data Engineer

    2 weeks ago

    Kanpur, Uttar Pradesh, India Betterbeans Consultants Pvt Ltd Full time

    Role : Senior Data EngineerExperience : 8-10 years' experienceSkill Set Required : Azure Data FactoryAzure DatabricksPythonSQL, PL/SQLSSISJob Role/Job Description : Senior Data Engineer will be responsible for designing, implementing, and maintaining data solutions on the Microsoft Azure Data platform and SQL Server (SSIS, SSAS, UC4 Atomic)Collaborate with...

  • Data Architect and Engineer

    2 days ago

    Kanpur, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Senior Data Engineer NeededWe're looking for a highly skilled data engineer to join our team.Hands-on expertise in Python and PySpark is essential.5+ years of experience in data engineering with a focus on big data, telemetry, and streaming analytics.The ideal candidate will have strong business acumen, excellent communication skills, and the ability to work...

  • TAVS Senior Data Engineer(Location: Pune)

    4 weeks ago

    Kanpur, Uttar Pradesh, India DigiHelic Solutions Pvt. Ltd. Full time

    TAVS Senior Data EngineerLocation: PuneExperience: 12 Years1. Proficiency in PostgreSQL, including database design, optimization, and management. 2. Extensive experience with Databricks for data processing and analytics, and/or any other Apache Spark distribution. 3. Strong programming skills in Python, especially with libraries such as Pandas and NumPy. 4....

  • Senior Data Engineer Position

    10 hours ago

    Kanpur, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 18,00,000 - ₹ 25,00,000

    Job OpportunityWe are seeking a highly skilled Senior Data Engineer with deep technical expertise in ETL pipeline design, data modeling, and data infrastructure. This role is perfect for someone who thrives in a fast-paced, engineering-driven environment.You'll work across the full data stack-from ingestion and transformation to orchestration and...

  • Senior Data Engineering Specialist

    2 days ago

    Kanpur, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Data EngineerWe are seeking a highly skilled and experienced Data Engineer to join our team. As a Data Engineer, you will be responsible for designing, building, and maintaining scalable data pipelines for data ingestion, processing, and storage.Key Responsibilities:Design and develop scalable data architectures and data models for efficient data...

  • Senior Informatica Developer

    4 days ago

    Kanpur, Uttar Pradesh, India Pacific Data Integrators Full time

    Job Title: Senior Data Engineer (IDMC-CDI)Primary Skills: SQL, IDMC (CDI), ETL Concepts BaseLocation: RemoteShift: US EST (5 PM to 2 AM IST)Experience: 5-12 YearsAbout UsWe are PDI (Pacific Data Integrators), a leading provider of Data Management, Analytics, and Cloud solutions. As an Informatica Platinum Partner and a reseller of various market-leading...

  • Senior Big Data Specialist

    2 days ago

    Kanpur, Uttar Pradesh, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Title: Senior Data EngineerDuties and ResponsibilitiesWe are seeking a highly skilled Data Engineer to design, develop, and maintain scalable data pipelines and ETL processes on Databricks.The ideal candidate will lead the architecture and implementation of high-performance data solutions, collaborating with business stakeholders, data scientists, and...

  • Data Engineer

    2 weeks ago

    Kanpur, Uttar Pradesh, India Natlov Technologies Pvt Ltd Full time

    We are looking for a skilled Data Engineer with expertise in AWS services and strong programming skills.Key Responsibilities:Build and maintain data pipelines and workflows using AWS services (Lambda, S3, DynamoDB, Glue, SageMaker).Develop and deploy solutions leveraging Python and Docker.Work on image processing tasks using libraries such as OpenCV (CV2),...

  • Senior Data Engineer

    2 days ago

    Kanpur, Uttar Pradesh, India beBeeDataIngestion Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Title: Azure Databricks Engineer with Injection ExperienceAbout the RoleWe are seeking a seasoned Azure Databricks Engineer to lead our data ingestion efforts. As a key member of our team, you will be responsible for designing, developing, and optimizing data pipelines to integrate multiple sources into Databricks.Key Responsibilities:Design and Develop...