Data Engineer 2

1 week ago

Bengaluru, Karnataka, India Yubi Full time

Data Engineer 2

Position Summary:

As a Data Engineer, you will be part of a highly talented Data Engineering team. Responsible for developing reusable capabilities and tools to automate various types of data processing pipelines. You will be contributing to different stages of data engineering like data acquisition, ingestion, processing, monitoring pipelines and validating data.

Your contribution will be really crucial in keeping various data ingestion and processing pipelines running successfully. Along with ensuring the data points available in the data lake are up to date, valid and usable.

Technology Experience:

  • 3+ years of experience in data engineering.
  • Comfortable and hands on with the Python programming.
  • Strong experience in working with RDBMS and NoSQL systems.
  • Strong experience in working on AWS ecosystem with hands-on experience in working with different AWS components like Airflow, EMR , Redshift, S3, Athena, PySpark etc.
  • Strong experience in developing REST APIs with Python using frameworks like flask, fastapi.
  • Prior experience in working with crawling libraries like BeautifulSoup in Python would be desirable.
  • Proven ability to work with SQL queries, including writing complex queries to retrieve key metrics. Skilled in connecting to, exploring, and understanding upstream data.
  • Experience working with various data lake storage format types and ability to choose it based on the use cases.

Responsibilities:

  • Design and build scalable data pipelines that can handle large volumes of data.
  • Develop ETL/ELT pipelines and extract the data from any upstream sources and sync with the data lakes with the format of parquet, iceberg, delta formats.
  • Optimize and ensure the data pipelines are running successfully and ensure the business continuity.
  • Collaborate with cross functional teams and source all the data required for the business use cases.
  • Stay up-to-date with emerging data technologies and trends to ensure the continuous improvement of our data infrastructure and architecture
  • Follow best practices in data querying and manipulation to ensure data integrity.

  • Data Engineer 2

    2 days ago

    Bengaluru, Karnataka, India Yubi Full time US$ 1,00,000 - US$ 1,50,000 per year

    About UsYubi stands for ubiquitous. But Yubi will also stand for transparency, collaboration, and the power of possibility.From being a disruptor in India's debt market to marching towards global corporate markets from one product to one holistic product suite with seven productsYubi is the place to unleash potential. Freedom, not fear. Avenues, not...

  • Data Engineer, 2

    4 days ago

    Bengaluru, Karnataka, India Dotdash Meredith Full time

    Job Title Data Engineer 2Primary responsibilities Create Star schema data models perform ETLs ELT and validate results with business representatives Collate raw data from various financial sources of the organization Push collated data into inhouse database run reports for dashboards and KPIs Support implemented BI solutions by monitoring and tuning...

  • Data Engineer

    5 days ago

    Bengaluru, Karnataka, India Data Analytics Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Get to Know the Team Grab has been expanding into multiple lines of businesses. The Grab Data Warehouse team builds business intelligence systems using data from all business lines to provide insights to key stakeholders across the company. Get to Know the Role We are looking for a Lead Data Engineer to lead the design and enhancement of our data...

  • Software Engineer 2 – Data Engineer

    5 days ago

    Bengaluru, Karnataka, India Her Second Innings Full time US$ 1,00,000 - US$ 1,50,000 per year

    Job Title: Software Engineer 2 – Data EngineerWork Location: BangaloreJob Description – What You'll DoThe Marketing Engineering organization in Strategy, Planning & Operations is looking for a Data Engineer eager to provide the engineering muscle for core engineering work around data architecture, data pipeline development, and deploying...

  • Data Engineer

    5 days ago

    Bengaluru, Karnataka, India NTT DATA Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Req ID: 338632NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer (HRIS,Tableau and BI) to join our team in Bangalore, Karnātaka (IN-KA), India (IN). Job Duties: Key...

  • Data Engineer

    5 days ago

    Bengaluru, Karnataka, India NTT DATA Full time US$ 90,000 - US$ 1,20,000 per year

    Req ID: 338630NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer (HRIS) to join our team in Bangalore, Karnātaka (IN-KA), India (IN). Job Duties: Key...

  • Data Engineer 2

    2 days ago

    Bengaluru, Karnataka, India beBeeDataEngineering Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Data Engineering SpecialistThe role entails designing and implementing scalable data pipelines to extract, process, and store large volumes of data in a secure and efficient manner.

  • Data Engineer- 2

    9 hours ago

    Bengaluru, Karnataka, India Jupiter Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    About Us:We are a financial services platform that leverages technology to offer our customers seamless and user-friendly products related to banking, loans, and investments. Our vision is to empower users to achieve financial wellness.We help users cut through the banking jargons, offer smart insights based on spending and provide users with a range of new...

  • Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India NTT DATA North America Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Req ID: NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer (Talend &Pyspark) to join our team in Bangalore, Karnātaka (IN-KA), India (IN)."Job Duties: Key...

  • Data Engineer 2

    4 days ago

    Bengaluru, Karnataka, India WEX Fintech Full time ₹ 15,00,000 - ₹ 28,00,000 per year

    About the Team/RoleAs a Data Engineer at WEX, youll be responsible for building and maintaining the bridge between our data and the rest of the organization. Youll work with stakeholders to understand business requirements and then implement SQL-first transformation workflows to deploy analytics code. You'll help ensure the integrity, reliability, and...