
Senior Data Engineer
4 hours ago
• Develop, construct, test and maintain data acquisition pipelines for large volumes of structed and unstructured data.
This includes batch and real-time processing (in google cloud)
• Build large and complex datasets based on business requirements
• Construct 'big data' pipeline architecture
• Identify opportunities for data acquisition via working with stakeholders and business clients
• Translate business needs to technical requirements
• Leverage a variety of tools in the Google Cloud Ecosystem such as Python, Data Flow, Data Stream, CDC (Change Data Capture), Cloud Functions, Cloud Run, Pub Sub, Big Query, Cloud Storage to integrate systems and data pipelines
• Use logs & alerts to effectively monitor pipelines
• Use SAP SLT to replicate SAP tables to Google Cloud using SLT
• Develop JSON messaging structure for integrating with various applications
• Leverage Dev Ops and CI/CD practices (Git Hub, Terraform) to ensure the reliability and scalability of data pipelines
• Partition/Cluster and retrieve content in Big Query and use IAM roles & Policy Tags to secure the data
• Use roles to secure access to datasets, authorized views to share data between projects
• Design and build an ingestion pipeline using Rest API
• Recommends ways to improve data quality, reliability, and efficiency Experience:
• Requires
• Junior DE: 2 to 3 years of experience in a GCP data engineering role (offshore)
• Senior DE: 4+ years of experience in a GCP data engineering role (offshore)
• Atleast 1 year of hands on experience in GCP tools highlighted(Python, SQL, Data Flow, Data Stream, CDC (Change Data Capture), Cloud Functions, Cloud Run, Pub Sub, Big Query, Cloud Storage)
-
Senior Azure Stack Engineer
1 week ago
Remote, India NTT Data Full timeJob DescriptionNTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Senior Azure Stack Engineer to join our team in Remote, Uttar Pradesh (IN-UP), India (IN).Job Title: Senior Azure Stack...
-
Senior Engineer, Data Engineering
4 days ago
India People Prime Worldwide Full timeAbout Client: Our Client is a multinational IT services and consulting company headquartered in USA, With revenues 19.7 Billion USD, with Global work force of 3,50,000 and Listed in NASDAQ, It is one of the leading IT services firms globally, known for its work in digital transformation, technology consulting, and business process outsourcing, Business...
-
Senior Data Engineer
7 days ago
India ADP Full time ₹ 15,00,000 - ₹ 20,00,000 per yearSenior Data Engineer with MLAbout the RoleWe are seeking an experienced Senior Data Engineer with 5-10 years of experience to join our data team. In this role, you will design, build, and maintain robust data pipelines that support both training and inference for our machine learning systems. You will work closely with data scientists to ensure seamless...
-
Senior Data Engineer
7 days ago
India Kinara Capital Full time ₹ 9,00,000 - ₹ 12,00,000 per year1 About Company Kinara Capital is a FinTech NBFC dedicated to driving Financial Inclusion in the MSME sector. Our mission is to transform lives, livelihoods, and local economies by providing fast and flexible loans without property collateral to small business entrepreneurs. Led by a women-majority management team, Kinara Capital values diversity and...
-
Senior Data Engineer
7 days ago
India Recruber Full time US$ 1,04,000 - US$ 1,30,878 per yearPosition: Senior Data Engineer / Data EngineerDesired Experience: 5-8 yearsLocation - RemoteSalary: Best-in-industry You will act as a key member of the Data consulting team, working directly with the partners and senior stakeholders of the clients designing and implementing big data and analytics solutions. Communication and organisation skills are keys for...
-
Senior Data Engineer
1 week ago
India beBeeData Full time ₹ 1,80,00,000 - ₹ 2,40,00,000Job Title: Senior Data EngineerWe are seeking a highly skilled Senior Data Engineer to join our team. As a key member of our data engineering team, you will play a vital role in designing, building, and maintaining large-scale data systems.About the Role:The ideal candidate will have a strong background in software engineering, with experience in building...
-
Senior Engineer, Data Engineering
1 week ago
India Collabera Full timeSenior Data Engineer Fully Remote Shift: US Time Zone (Night Shift)Financial Institution (FI) - Credit Union Collabera is seeking a seasoned Senior Data Engineer for its leading financial customer to design and optimize data solutions that power our analytics, reporting, and Member 360 initiatives. This role is ideal for someone with deep expertise in ETL...
-
Senior Data Engineer
5 days ago
India Collabera Full timeSenior Data Engineer Arrangement: Fully Remote Shift: US Time Zone (Night Shift) Industry: Financial Institution (FI) - Credit Union Job Summary Collabera is seeking a seasoned Senior Data Engineer for its leading financial customer to design and optimize data solutions that power our analytics, reporting, and Member 360 initiatives. This role is ideal...
-
Senior Engineer, Data Engineering
4 days ago
India SID Information Technologies Full timeRole: Senior Data Engineer Experience: 4–8 years Work Mode: Hybrid (3 days/week in-office)Join Time: Immediate Strong programming skills in Python and/or Scala Hands-on experience with Apache Spark for big data processing on AWS cloud Proficiency with AWS services such as S3, Glue, Redshift, EMR, Lambda Strong SQL skills for data...
-
Senior Data Engineer
2 days ago
India Thomson Reuters Full timeSenior Data Engineer - Enterprise AnalyticsWant to be part of the Data Analytics organization whose strategic goal is to create a world-class Data Analytics company by building embedding and maturing a data-driven culture across Thomson Reuters We are looking for a highly motivated individual with strong organizational and technical skills for the...