Data Engineer

6 days ago

India IT AISA Full time US$ 90,000 - US$ 1,20,000 per year

We are looking for a Data Engineer to join our growing team of data enthusiasts. The hire will be responsible for expanding and optimizing our data and data pipeline architecture, as well as optimizing data flow and collection for cross functional teams. The ideal candidate is an experienced data pipeline builder and data wrangler who enjoys optimizing data systems and building them from the ground up. Responsibilities :

  • Working with stakeholders including the Executive, Product, Data and Design teams to assist with data-related technical issues and support their data infrastructure needs.
  • Keeping our data separated and secure across national boundaries through multiple data centers and AWS\GCP regions.
  • Assembling large, complex data sets that meet functional / non-functional business requirements.
  • Creating and maintaining optimal data pipeline architecture.
  • Creating data tools for analytics and data scientist team members that assist them in building and optimizing our product into an innovative industry leader.
  • Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
  • Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using Databricks, SQL and AWS 'big data' technologies.

Technical Skills :

  • 5 years of experience in a Data Engineer role, who has attained a Graduate degree in Computer Science, Statistics, Informatics, Information Systems or another quantitative field.
  • SQL knowledge and experience working with relational and noSQL databases, query authoring (SQL) as well as working familiarity with a variety of databases.
  • Experience Designing, building and optimizing data pipelines, and data sets.
  • Experience performing root cause analysis on internal and external data and processes to answer specific business questions and identify opportunities for improvement.
  • Experience in setting up and implementing data platforms such as new infrastructure, VPC setting, security settings and configurations on cloud platform such as Azure, GCP or AWS.
  • Strong analytic skills related to working with unstructured datasets.

They should also have proven experience using the following software/tools :

  • Experience with relational SQL and NoSQL databases, including Postgres, Oracle, mySQL and mongoDB.
  • Experience with Databricks (mandatory).
  • Experience with data pipeline orchestration and workflow management tools: Airflow, Astronomer, etc (mandatory).
  • Experience with AWS cloud services: S3, EC2, EMR, RDS, Redshift, Glue.
  • Experience with object-oriented/object function scripting languages: Python (mandatory), Java, C++, Scala, etc.
  • Experience with Git.

Note: Its a pure remote role. )

  • Data Analyst

    1 week ago

    India Quant-data Full time

    We're Hiring: Data Analyst (Credit Analytics | Remote | Full-Time) Leverage financial and credit data to power AI-driven lending solutions We are seeking a skilled Data Analyst (Credit Analytics) with 4+ years of experience to join our AI-driven lending platform team . In this role, you will analyze financial, customer, and transaction datasets ,...

  • AI Security Engineer

    1 week ago

    India NTT Data Full time

    Job DescriptionNTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a AI Security Engineer - Shared Security Services Engineering to join our team in Banaglore, Karntaka (IN-KA), India...

  • AI Security Engineer

    6 days ago

    India NTT DATA Full time US$ 1,04,000 - US$ 1,30,878 per year

    Req ID: 338875NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a AI Security Engineer - Shared Security Services Engineering to join our team in Banaglore, Karnātaka (IN-KA), India...

  • Mid-Level Azure Stack Engineer

    3 days ago

    India NTT DATA Full time US$ 1,04,000 - US$ 1,30,878 per year

    Req ID: 336843NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Mid-Level Azure Stack Engineer to join our team in Remote, Karnātaka (IN-KA), India (IN). Job Title: Mid-Level Azure...

  • Sensor & Machine Vision Engineer

    5 days ago

    India Pando Data Full time

    Sensor & Machine Vision Engineer At Pando Data , we're on a mission to bring Industry 4.0 to life in factories that need it most. We design smart, affordable AI + sensor systems that actually work on the shop floor - from measuring steel bars flying out of a rolling mill, to spotting defects in plastic pipes, to preventing theft in dispatch yards....

  • Data Engineer

    1 week ago

    India NP Group Full time

    Data Engineer - Palantir Foundry, Workshop, Pyspark & Typescript Fully Remote 6 month full time contract Rate: $15.00 per hour We have an immediate requirement for an experienced Data Engineer to join the global engineering team for a International Enterprise Organisation.You will bring Data Engineering expertise onto greenfield multi year project...

  • Data Engineer

    6 days ago

    India Qubryx Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Job Title : Data Engineer (Contract) (US)Location : Houston, TX ( 2-3 days at client location)Job Type : ContractExperience : 8+ yearsJob Description :We are looking for an experienced Data Engineer to join our team on a contract basis. The ideal candidate will have a strong background in data engineering with hands-on experience in Python, Pandas, and...

  • Data Engineer

    2 days ago

    India Tata Consultancy Services Full time

    Dear Candidates,Greetings from TCSTCS is looking for Data EngineerExperience: 10-14 yearsLocation: BangaloreJob Summary:In this key leadership role, you will lead the development of foundational components for a Lakehouse architecture on AWS and drive the migration of existing data processing workflows to the new Lakehouse solution. You will work across the...

  • Data Engineer

    5 days ago

    India AQb Solutions Pvt Ltd Full time

    We are looking for a highly skilled Data Engineer with strong expertise in Postgre SQL and hands-on experience in building data warehouses and data lakes.In this role, you will design and implement a scalable Postgre SQL-based data warehouse and manage a data lake on AWS infrastructure, leveraging primarily open-source technologies.The ideal candidate has a...

  • Data Engineer

    3 days ago

    India Amazon Music Full time

    Job DescriptionDESCRIPTIONWe are seeking a highly skilled Data Engineer to join our FinTech ADA team, responsible for building and optimizing scalable data pipelines and platforms that power analytics, automation, and decision-making across Finance and Accounting domains. The ideal candidate will have strong expertise in AWS cloud technologies including...