Leading Data Engineer

4 days ago

Bengaluru, Karnataka, India beBeeData Full time ₹ 1,04,000 - ₹ 1,30,878
Job Description

Senior Engineer: Data Ingestion and Analytics

Develop and deliver elements of engineering solutions to accomplish business goals. Develop and maintain stable and scalable data ingestion workflows, integrating into existing workflows.

  • Design and code data ingestion pipelines for large-scale datasets.
  • Collaborate with team members and stakeholders to clarify requirements and provide the appropriate ETL solution.
  • Work as a senior developer to develop analytics algorithms on top of ingested data.
  • Source data from Hadoop and GCP.
  • Own unit testing, UAT deployment, end-user sign-off, and prod go-live.
Required Skills and Qualifications

More Than 10 Years of Coding Experience in Reputed Organizations

  • Hands-on experience with Bitbucket and CI/CD pipelines.
  • Proficient in Hadoop, Python, Spark, SQL, Unix, and Hive.
  • Basic understanding of on-prem and GCP data security.
  • Hands-on development experience in large ETL/big data systems, with GCP being a plus.
  • Experience with cloud build, artifact registry, cloud DNS, cloud load balancing, etc.
  • Experience with Dataflow, Cloud Composer, Cloud Storage, and DataProc, etc.
  • Basic understanding of data quality dimensions like consistency, completeness, accuracy, lineage, etc.
  • Business and systems knowledge gained in a regulatory delivery environment.
  • Desired banking experience, regulatory, and cross-product knowledge.
  • Prior experience with release management tasks and responsibilities.
  • Data visualization experience is a plus.
Benefits

Join Our Team of Experts

As a senior engineer, you will have the opportunity to work with a geographically dispersed team and contribute to the buildout of Compliance tech internal development team in India.

The overall team will primarily deliver improvements in compliance tech capabilities that are major components of the regular regulatory portfolio addressing various regulatory common commitments to mandate monitors.

  • Data Engineer

    4 days ago

    Bengaluru, Karnataka, India Data Analytics Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Get to Know the Team Grab has been expanding into multiple lines of businesses. The Grab Data Warehouse team builds business intelligence systems using data from all business lines to provide insights to key stakeholders across the company. Get to Know the Role We are looking for a Lead Data Engineer to lead the design and enhancement of our data...

  • Data Engineer

    4 days ago

    Bengaluru, Karnataka, India Leading Digital Product Company Full time

    Key Responsibilities :- Design, build, and optimize scalable data pipelines and dataflows in Azure Data Factory / Azure Synapse following the Medallion Architecture (Bronze, Silver, Gold layers).- Develop and manage data ingestion processes from diverse sources into Azure Data Lake.- Implement and optimize data transformations using PySpark / Databricks.-...

  • Lead Data Scientist

    4 days ago

    Bengaluru, Karnataka, India Aptus Data Labs Full time US$ 1,25,000 - US$ 1,75,000 per year

    Job Description: Senior/lead Data ScientistLocation: Bangalore/WFHEmployment Type: Full-timeAbout the RoleWe are seeking a highly skilled Senior /lead Data Scientist with strong expertise in Artificial Intelligence (AI), Machine Learning (ML), Deep Learning, and Natural Language Processing (NLP). The ideal candidate will also have hands-on exposure to...

  • Gcp Lead Engineer

    2 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Req ID 298270NTT DATA strives to hire exceptional innovative and passionate individuals who want to grow with us If you want to be part of an inclusive adaptable and forward-thinking organization apply now We are currently seeking a GCP Lead Engineer to join our team in Bangalore Karn xc4 x81taka IN-KA India IN Primary Skill ...

  • Lead Data Scientist

    1 week ago

    Bengaluru, Karnataka, India Enable Data Incorporated Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Enable Data Incorporated is looking for a talented and experienced Lead Data Scientist to join our innovative team. In this role, you will be responsible for driving data science initiatives, developing predictive models, and providing insights that guide key business decisions. The ideal candidate has a strong background in statistical analysis, machine...

  • Lead Data Scientist

    4 days ago

    Bengaluru, Karnataka, India Enable Data Incorporated Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Enable Data Incorporated is looking for a talented and experienced Lead Data Scientist to join our innovative team. In this role, you will be responsible for driving data science initiatives, developing predictive models, and providing insights that guide key business decisions. The ideal candidate has a strong background in statistical analysis, machine...

  • Data Senior Engineer

    4 days ago

    Bengaluru, Karnataka, India NTT DATA Full time US$ 80,000 - US$ 1,20,000 per year

    Req ID: 337669NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Senior Engineer to join our team in Bangalore, Karnātaka (IN-KA), India (IN). Job Duties: 8+ years of experience...

  • Data Engineer

    4 days ago

    Bengaluru, Karnataka, India NTT DATA Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Req ID: 338632NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer (HRIS,Tableau and BI) to join our team in Bangalore, Karnātaka (IN-KA), India (IN). Job Duties: Key...

  • Data Engineer

    4 days ago

    Bengaluru, Karnataka, India NTT DATA Full time US$ 90,000 - US$ 1,20,000 per year

    Req ID: 338630NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer (HRIS) to join our team in Bangalore, Karnātaka (IN-KA), India (IN). Job Duties: Key...

  • Urgent Data Engineer

    3 weeks ago

    Bengaluru, Karnataka, India NTT Data Full time

    Job DescriptionNTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer - ETL to join our team in Bangalore, Karntaka (IN-KA), India (IN).Job Duties:. Migrate ETL workflows from...