Senior data engineer

2 days ago

Moradabad, India Egen Full time

Senior Data Engineer – GCP Job Overview: We are looking for a skilled and motivated Senior Data Engineer with strong experience in Python programming and Google Cloud Platform (GCP) to join our data engineering team. The ideal candidate will be responsible for designing, developing, and maintaining robust and scalable ETL (Extract, Transform, Load) data pipelines. The role involves working with various GCP services, implementing data ingestion and transformation logic, and ensuring data quality and consistency across systems. Experience Level: 4 to 8 years of relevant IT experience Key Responsibilities: Design, develop, test, and maintain scalable ETL data pipelines using Python. Work extensively on Google Cloud Platform (GCP) services such as: Dataflow for real-time and batch data processing Cloud Functions for lightweight serverless compute Big Query for data warehousing and analytics Cloud Composer for orchestration of data workflows (based on Apache Airflow) Google Cloud Storage (GCS) for managing data at scale IAM for access control and security Cloud Run for containerized applications Should have experience in the following areas : API framework: Python Fast API Processing engine: Apache Spark Messaging and streaming data processing : Kafka Storage: Mongo DB, Redis/Bigtable Orchestration: Airflow Perform data ingestion from various sources and apply transformation and cleansing logic to ensure high-quality data delivery. Implement and enforce data quality checks, validation rules, and monitoring. Collaborate with data scientists, analysts, and other engineering teams to understand data needs and deliver efficient data solutions. Manage version control using Git Hub and participate in CI/CD pipeline deployments for data projects. Write complex SQL queries for data extraction and validation from relational databases such as SQL Server, Oracle, or Postgre SQL. Document pipeline designs, data flow diagrams, and operational support procedures. Required Skills: 4-8 years of hands-on experience in Python for backend or data engineering projects. Strong understanding and working experience with GCP cloud services (especially Dataflow, Big Query, Cloud Functions, Cloud Composer, etc.). Solid understanding of data pipeline architecture, data integration, and transformation techniques. Experience in working with version control systems like Git Hub and knowledge of CI/CD practices. Experience in Apache Spark, Kafka, Redis, Fast APIs, Airflow, GCP Composer DAGs. Strong experience in SQL with at least one enterprise database (SQL Server, Oracle, Postgre SQL, etc.). Experience in data migrations from on-premise data sources to Cloud platforms. Good to Have (Optional Skills): Experience working with Snowflake cloud data platform. Experience in deployments in GKE, Cloud Run. Hands-on knowledge of Databricks for big data processing and analytics. Familiarity with Azure Data Factory (ADF) and other Azure data engineering tools. Additional Details: Excellent problem-solving and analytical skills. Strong communication skills and ability to collaborate in a team environment.

  • Senior GCP Data Engineer

    3 weeks ago

    Moradabad, India Adastra Full time

    Job Description We are seeking a results-driven GCP Data Engineer with a proven track record in architecting and delivering end-to-end data migration solutions. The ideal candidate will have extensive experience migrating complex, large-scale on-premises data systems (Oracle, Teradata, SQL Server, etc.) to Google Cloud Platform (GCP), and optimizing...

  • Senior data engineer

    2 weeks ago

    Moradabad, India Coffeee.io Full time

    Job Title: Lead Data Engineer – Snap LogicLocation: RemoteExperience: 8+ years (with 3+ years in Snap Logic ETL)Employment Type: Full-timeRole Overview:We are seeking a Lead Data Engineer – Snap Logic to design, build, and optimize data integration pipelines across on-premise and cloud platforms. The ideal candidate will have hands-on experience with...

  • Senior Data Analyst_Remote

    3 weeks ago

    Moradabad, India Bee Talent Solutions Full time

    As a Senior Data Analyst, you'll be at the forefront of fostering a data-driven culture across our client's organization. Your role extends beyond traditional data analysis; you'll play a pivotal role in extracting actionable insights from complex datasets to drive strategic decisions and enhance product development. You will collaborate closely with...

  • Senior Data Engineer – ETL

    3 days ago

    Moradabad, India AIMLEAP Full time

    Senior Data Engineer – ETL & Pipeline Development Experience: 7 to 12 YearsLocation: Remote (Work from Home) / Bangalore / IndiaMode of Engagement: Full-timeNo. of Positions: 2Educational Qualification: B.E / B.Tech / M.Tech / MCA / Computer Science / ITIndustry: IT / Data / AI / LegalTech / Enterprise SolutionsNotice Period: Immediate Joiners...

  • Senior llm engineer

    1 week ago

    Moradabad, India IdeaSouq Full time

    About Us At Idea Souq, we are building the "AI operating system" to transform how private market investors and funds discover, evaluate, and manage their opportunities. Traditional investment workflows are drowning in data silos, manual screening, and overwhelming deal flow. We're a startup building the solution: an AI analyst that turns this deal flow chaos...

  • Data Engineer

    3 weeks ago

    Moradabad, India Tata Consultancy Services Full time

    Opening - PUNE/Bangalore/Hyd/ChennaiAbout the RoleRole - Data Engineer - Quantexa ,Big Data Hadoop, Spark and ScalaResponsibilitiesDevelop Spark and SCALA code as per requirement.Build efficient and optimized ETLs for data ingestion/transformations.Should be able to customize and update the Quantexa UI as per business requirement.Documentation of the...

  • Senior Data

    3 weeks ago

    Moradabad, India Kooner Transport Group - KTG Full time

    Location: Remote/ Uttarakhand - Ramnagar Office Type: 3-Month Contract (extendable based on performance) Work Hours: Must overlap 3–4 hours/day with Eastern Time (Canada) Compensation: ₹100,000 – ₹150,000 INR per month (depending on skill & experience)About the RoleKooner Transport Group (Canada) operates a large cross-border trucking fleet with over...

  • Data Architect

    3 weeks ago

    Moradabad, India People Prime Worldwide Full time

    Important Note (Please Read Before Applying)🚫 Do NOT apply if:You have less than 10 years of experience in data architectureYou do not have hands-on experience in implementing data integrationsYou come from a purely non-architecture background (e.g., only reporting/analyst roles)✅ Apply ONLY if you meet ALL the mandatory requirements listed above....

  • Freelance Data Engineer

    3 weeks ago

    Moradabad, India upGrad Full time

    We are seeking a highly skilled and motivated Data Engineer to join our team. The ideal candidate will be responsible for designing, developing, and optimizing large-scale data pipelines and data warehouse solutions, utilizing a modern, cloud-native data stack. You'll play a crucial role in transforming raw data into actionable insights, ensuring data...

  • Backend engineer — data

    3 weeks ago

    Moradabad, India Branch International Full time

    Branch OverviewImagine a world where every person has improved access to financial services. People could start new businesses, pay for their children’s education, cover their emergency medical bills – the possibilities to improve life are endless.Branch is a global technology company revolutionizing financial access for millions of underserved banking...