Data Engineer

Found in: Whatjobs IN C2 - 3 weeks ago

chennai, India IDP Education Full time

About Us:

An ASX100 business part that is owned by Australian universities, IDP is a pioneer in international education services. Our core business lines include student placement to Australia, US, UK, Canada and New Zealand institutions, English-language testing, and training.

We are on a mission to build the world's leading platform and connected community to guide students along their journey to achieve their lifelong learning and career aspirations.

As a co-owner of IELTS, we deliver the English test that is trusted by more governments, universities, and organizations than any other. We also operate English-language teaching schools in Southeast Asia.

We are innovators, driven by the needs of our customers and deep data insights. Our 5,000 team members based around the world understand that our services change lives – not only of our customers, but their wider communities. Over its half century as a business service provider, IDP has amassed an enormous volume of data, which is its core IP. IDP operates in 33 countries for Student placement and in 60 countries for IELTS. Our websites have over 100 million visitors a year and have the World’s most comprehensive course and institution search across 40+ sites.

By combining empathy and professional expertise with digital excellence, we create launch pads for our customers to achieve global success.

Responsibilities:

In this role, you will be collaborating with IDP’s Data Engineering and Governance, an enterprise capability team, and be responsible for driving transformation efforts towards the right outcomes for students, clients, and the student placement network.

Develops and maintains scalable data pipelines and builds out new API integrations to support continuing increases in data volume and complexity. Collaborates with analytics and business teams to improve data models that feed business intelligence tools, increasing data accessibility and fostering data-driven decision-making across the organization

performs the data analysis required to troubleshoot data-related issues and assist in the resolution of data issues. building the necessary infrastructure using AWS and SQL technologies. This will enable effective data extraction, transformation, and loading from a variety of data sources. Collaborate with engineers in Australia and India on existing IDP architecture patterns. Drive good practice in data capture within the campus to ensure that data accurately reflects activity.

Take responsibility for Outcomes

You love technology and are continuously learning and extending your knowledge of best practices and the business value of technological innovations.

Here’s what we’re looking for:

Bachelor's or master’s in software engineering, Computer Science, or other relevant disciplines Strong Knowledge in SQL and Python v3.x Can analyze new source data, model entities, and write complex SQL. Minimum 7 years of Overall Development Experience and at least 4+ years on SQL coding and 2+ years on Python Could have worked on AWS Lambda and Microservices development. Advanced SQL, Python, CDK, Terraform, Lambda, and scheduling software Ability to question, probe, and demonstrate understanding of a problem and to propose or check a possible solution to that problem.

Desirable Requirements

Experience with Large Language Models

WORKING AT IDP

IDP Education’s ongoing success comes from our highly committed and caring employees around the globe. We encourage teamwork in order to leverage our people's diverse talents and expertise through effective collaboration and cooperation throughout our business.
We strive to provide a working environment where people are encouraged to excel, be creative, seek new ways to solve problems, take initiative, generate opportunities, and be accountable for their actions.
We believe in developing dynamic, inclusive workplaces that encourage and celebrate cultural differences and views and provide opportunities for personal, professional, and career development all around the world. We respect diversity in our people—their ideas, work styles, and perspectives—as well as offering flexibility to ensure employees enjoy a satisfying balance of work and personal life.

  • Wavicle Data Solutions

    Found in: Whatjobs IN C2 - 3 weeks ago

    Chennai,Coimbatore, India Wavicle data solutions Full time

    Job Description :- We are seeking a highly experienced Senior and Lead Data Engineer with over 6 years of expertise in data engineering.- As a Lead Data Engineer, you will play a pivotal role in architecting and implementing data solutions.- Your proficiency in Python, PySpark, AWS/Azure, Databricks/Snowflake, SQL, and leadership skills will be crucial for...

  • Wavicle Data Solutions

    Found in: Whatjobs IN C2 - 2 days ago

    Chennai/Coimbatore, India Wavicle data solutions Full time

    Job Description :- We are seeking a highly experienced Senior and Lead Data Engineer with over 6 years of expertise in data engineering.- As a Lead Data Engineer, you will play a pivotal role in architecting and implementing data solutions.- Your proficiency in Python, PySpark, AWS/Azure, Databricks/Snowflake, SQL, and leadership skills will be crucial for...

  • Autocad Draughtsman/woman

    3 days ago

    Chennai, India Planners and Engineer Full time

    Requirement for Auto cad those have knownledge in Pre DCR ONLINE DRAWING WORKING DRAWING & CMDA APPROVAL DRAWING & LAYOUT BASED COMBINED DRAWING. - Should have excellent communication skills - Ability to work independently with little supervision as well as the ability to work within a team. - Excellent multi-tasking skills - Self-motivated with strong team...

  • Digital Engineering Sr. Engineer

    Found in: beBee S IN - 3 weeks ago

    Chennai, India NTT DATA Services Full time

    Req ID: 276696  NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Digital Engineering Sr. Engineer to join our team in Chennai, Tamil Nādu (IN-TN), India...

  • Data Engineer

    Found in: Whatjobs IN C2 - 1 week ago

    Chennai, India Encora Inc. Full time

    Description hereLead Data EngineerJD :Qualifications5 to 10 years of hands-on Big Data Engineering experienceExcellent communication and collaboration skillsDemonstrated strong leadership skills in leading a teamKey responsibilities include: ·Create and maintain data pipelines to transform and load data from data lake into Datawarehouse modelsImplement...

  • Data Engineer

    Found in: Whatjobs IN C2 - 2 weeks ago

    Chennai, India KAYA Global Full time

    As a Senior Azure Data Engineer, your primary role is to design, implement, and manage data solutions on the Microsoft Azure cloud platform. You will work closely with data architects, data scientists, and other stakeholders to develop and optimize data pipelines, data storage, and analytics solutions. Your expertise in Azure technologies will contribute to...

  • Data Engineer

    Found in: Whatjobs IN C2 - 3 weeks ago

    chennai, India Encora Inc. Full time

    Description here Lead Data Engineer  JD :  Qualifications 5 to 10 years of hands-on Big Data Engineering experience Excellent communication and collaboration skills Demonstrated strong leadership skills in leading a team Key responsibilities include: ·  Create and maintain data pipelines to transform and load data from...

  • Data Engineer

    Found in: Talent IN C2 - 3 weeks ago

    Chennai, India Encora Inc. Full time

    Description here Lead Data Engineer  JD :  Qualifications 5 to 10 years of hands-on Big Data Engineering experience Excellent communication and collaboration skills Demonstrated strong leadership skills in leading a team Key responsibilities include: ·  Create and maintain data pipelines to transform and load data from data lake into...

  • Data Engineer

    Found in: Whatjobs IN C2 - 3 days ago

    Chennai, India HTC Global Services Full time

    Position Description:• This role is for experienced Data Engineer that will be responsible for designing and building the foundational components required for our customer. This includes bringing disparate sources into our Data Factory and creating data products that will be used by the analytics and reporting teams. • Data engineers will work in small,...

  • Digital Engineering Staff Engineer

    Found in: beBee S IN - 4 weeks ago

    Chennai, India NTT DATA Services Full time

    Req ID: 275559  NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Digital Engineering Staff Engineer to join our team in Chennai, Tamil Nādu (IN-TN), India...

  • Data Engineer

    Found in: Whatjobs IN C2 - 1 week ago

    Chennai, India LAMDA DIGITAL LTD Full time

    Analyzing raw dataDeveloping and maintaining datasetsImproving data quality and efficiencyThese responsibilities may vary based on each company's needs. When crafting your own data engineer job description, make sure to tailor them accordingly.We are looking for an experienced data engineer to join our team. You will use various methods to transform raw data...

  • Data Engineer

    Found in: Talent IN 2A C2 - 3 weeks ago

    Chennai, India KAYA Global Full time

    As a Senior Azure Data Engineer, your primary role is to design, implement, and manage data solutions on the Microsoft Azure cloud platform. You will work closely with data architects, data scientists, and other stakeholders to develop and optimize data pipelines, data storage, and analytics solutions. Your expertise in Azure technologies will contribute to...

  • Data Engineer

    Found in: Appcast Linkedin IN C2 - 3 weeks ago

    Chennai, India KAYA Global Full time

    As a Senior Azure Data Engineer, your primary role is to design, implement, and manage data solutions on the Microsoft Azure cloud platform. You will work closely with data architects, data scientists, and other stakeholders to develop and optimize data pipelines, data storage, and analytics solutions. Your expertise in Azure technologies will contribute to...

  • Data Engineer

    Found in: Whatjobs IN C2 - 3 weeks ago

    Chennai, India KAYA Global Full time

    As a Senior Azure Data Engineer, your primary role is to design, implement, and manage data solutions on the Microsoft Azure cloud platform. You will work closely with data architects, data scientists, and other stakeholders to develop and optimize data pipelines, data storage, and analytics solutions. Your expertise in Azure technologies will contribute to...

  • Data Engineer

    Found in: Talent IN 2A C2 - 5 days ago

    Chennai, India HTC Global Services Full time

    Position Description:• This role is for experienced Data Engineer that will be responsible for designing and building the foundational components required for our customer. This includes bringing disparate sources into our Data Factory and creating data products that will be used by the analytics and reporting teams. • Data engineers will work in small,...

  • Data Engineer

    Found in: Appcast Linkedin IN C2 - 5 days ago

    Chennai, India HTC Global Services Full time

    Position Description:• This role is for experienced Data Engineer that will be responsible for designing and building the foundational components required for our customer. This includes bringing disparate sources into our Data Factory and creating data products that will be used by the analytics and reporting teams. • Data engineers will work in small,...

  • Data Engineer

    Found in: Whatjobs IN C2 - 3 weeks ago

    chennai, India LAMDA DIGITAL LTD Full time

    Analyzing raw data Developing and maintaining datasets Improving data quality and efficiency These responsibilities may vary based on each company's needs. When crafting your own data engineer job description, make sure to tailor them accordingly.We are looking for an experienced data engineer to join our team. You will use various methods to transform raw...

  • Data Engineer

    Found in: Talent IN C2 - 3 weeks ago

    Chennai, India LAMDA DIGITAL LTD Full time

    Analyzing raw dataDeveloping and maintaining datasetsImproving data quality and efficiencyThese responsibilities may vary based on each company's needs. When crafting your own data engineer job description, make sure to tailor them accordingly.We are looking for an experienced data engineer to join our team. You will use various methods to transform raw data...

  • Database Engineer

    Found in: Whatjobs IN C2 - 3 days ago

    Chennai, India Clustrex Data Private Limited Full time

    Job Title: Database Engineer - Performance Tuning, Security & Cloud Solutions SpecialistExperience - 2-8 yearsJob Description:Clustrex Data Private Limited is looking for a seasoned Database Engineer with expertise in performance tuning, query optimization, database security, and cloud database solutions such as AWS RDS PostgreSQL. The successful candidate...

  • Data Engineer

    Found in: Whatjobs IN C2 - 3 days ago

    Chennai, India KONE Full time

    To succeed in this role, following professional experience will play a key role:Master's degree in either software engineering, data engineering, data science, computer science, physics, statistics, mathematics, or a related fieldData engineering professional experiencePrevious hands-on professional experience in developing and maintaining data pipelines on...