Senior Data Engineer

4 hours ago


India Deltacubes Full time
Job description:
• Develop, construct, test and maintain data acquisition pipelines for large volumes of structed and unstructured data.

This includes batch and real-time processing (in google cloud)
• Build large and complex datasets based on business requirements
• Construct 'big data' pipeline architecture
• Identify opportunities for data acquisition via working with stakeholders and business clients
• Translate business needs to technical requirements
• Leverage a variety of tools in the Google Cloud Ecosystem such as Python, Data Flow, Data Stream, CDC (Change Data Capture), Cloud Functions, Cloud Run, Pub Sub, Big Query, Cloud Storage to integrate systems and data pipelines
• Use logs & alerts to effectively monitor pipelines
• Use SAP SLT to replicate SAP tables to Google Cloud using SLT
• Develop JSON messaging structure for integrating with various applications
• Leverage Dev Ops and CI/CD practices (Git Hub, Terraform) to ensure the reliability and scalability of data pipelines
• Partition/Cluster and retrieve content in Big Query and use IAM roles & Policy Tags to secure the data
• Use roles to secure access to datasets, authorized views to share data between projects
• Design and build an ingestion pipeline using Rest API
• Recommends ways to improve data quality, reliability, and efficiency Experience:
• Requires
• Junior DE: 2 to 3 years of experience in a GCP data engineering role (offshore)
• Senior DE: 4+ years of experience in a GCP data engineering role (offshore)
• Atleast 1 year of hands on experience in GCP tools highlighted(Python, SQL, Data Flow, Data Stream, CDC (Change Data Capture), Cloud Functions, Cloud Run, Pub Sub, Big Query, Cloud Storage)

  • Remote, India NTT Data Full time

    Job DescriptionNTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Senior Azure Stack Engineer to join our team in Remote, Uttar Pradesh (IN-UP), India (IN).Job Title: Senior Azure Stack...


  • India People Prime Worldwide Full time

    About Client: Our Client is a multinational IT services and consulting company headquartered in USA, With revenues 19.7 Billion USD, with Global work force of 3,50,000 and Listed in NASDAQ, It is one of the leading IT services firms globally, known for its work in digital transformation, technology consulting, and business process outsourcing, Business...


  • India ADP Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Senior Data Engineer with MLAbout the RoleWe are seeking an experienced Senior Data Engineer with 5-10 years of experience to join our data team. In this role, you will design, build, and maintain robust data pipelines that support both training and inference for our machine learning systems. You will work closely with data scientists to ensure seamless...


  • India Kinara Capital Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    1 About Company Kinara Capital is a FinTech NBFC dedicated to driving Financial Inclusion in the MSME sector. Our mission is to transform lives, livelihoods, and local economies by providing fast and flexible loans without property collateral to small business entrepreneurs. Led by a women-majority management team, Kinara Capital values diversity and...


  • India Recruber Full time US$ 1,04,000 - US$ 1,30,878 per year

    Position: Senior Data Engineer / Data EngineerDesired Experience: 5-8 yearsLocation - RemoteSalary: Best-in-industry You will act as a key member of the Data consulting team, working directly with the partners and senior stakeholders of the clients designing and implementing big data and analytics solutions. Communication and organisation skills are keys for...


  • India beBeeData Full time ₹ 1,80,00,000 - ₹ 2,40,00,000

    Job Title: Senior Data EngineerWe are seeking a highly skilled Senior Data Engineer to join our team. As a key member of our data engineering team, you will play a vital role in designing, building, and maintaining large-scale data systems.About the Role:The ideal candidate will have a strong background in software engineering, with experience in building...


  • India Collabera Full time

    Senior Data Engineer Fully Remote Shift: US Time Zone (Night Shift)Financial Institution (FI) - Credit Union Collabera is seeking a seasoned Senior Data Engineer for its leading financial customer to design and optimize data solutions that power our analytics, reporting, and Member 360 initiatives. This role is ideal for someone with deep expertise in ETL...


  • India Collabera Full time

    Senior Data Engineer Arrangement: Fully Remote Shift: US Time Zone (Night Shift) Industry: Financial Institution (FI) - Credit Union Job Summary Collabera is seeking a seasoned Senior Data Engineer for its leading financial customer to design and optimize data solutions that power our analytics, reporting, and Member 360 initiatives. This role is ideal...


  • India SID Information Technologies Full time

    Role: Senior Data Engineer Experience: 4–8 years Work Mode: Hybrid (3 days/week in-office)Join Time: Immediate Strong programming skills in Python and/or Scala Hands-on experience with Apache Spark for big data processing on AWS cloud Proficiency with AWS services such as S3, Glue, Redshift, EMR, Lambda Strong SQL skills for data...


  • India Thomson Reuters Full time

    Senior Data Engineer - Enterprise AnalyticsWant to be part of the Data Analytics organization whose strategic goal is to create a world-class Data Analytics company by building embedding and maturing a data-driven culture across Thomson Reuters We are looking for a highly motivated individual with strong organizational and technical skills for the...