AWS Data Engineer

3 weeks ago

Chennai, India LexisNexis Full time

Software Engineer III

Do you enjoy designing analytic solutions at an enterprise scale for global customers?

Do you have experience in working on complex problems?

About our Team

Our product analytics team focuses on using data to understand and enhance the user experience of our customer facing products. We gather and analyze user interaction data from various sources to track how users engage with a product. The insights derived from this analysis help identify usage patterns, pinpoint areas for improvement, and influence product development decisions. By constantly monitoring key metrics related to the product usage, the product analytics team plays a crucial role in driving product strategy, optimizing user engagement, and ultimately contributing to the product’s success.

About the role

The role in focus involves designing and implementing robust data pipelines utilizing AWS, Python, and SQL to underpin product analytics and decision-making. As a data engineer, you'll ensure the integrity and performance of data processing and storage systems, optimize data flows within AWS for enhanced performance, and develop efficient ETL processes and APIs. Collaboration with cross-functional teams will be crucial to gather and address technical requirements, while ongoing responsibilities include maintaining and enhancing data models, troubleshooting data issues, and documenting all procedures for future reference and compliance. This role demands a proactive approach to integrating new technologies and continuous improvement of systems to support the data management team in both daily operations and strategic projects.

Responsibilities:

• Design and implement robust data pipelines using AWS, Python, and SQL to support business analytics and decision-making processes.

• Ensure data integrity and performance of data processing and storage systems.

• Optimize data flows and architecture within AWS to enhance performance and scalability.

• Develop and maintain scalable and efficient ETL processes and APIs for data interaction.

• Collaborate with cross-functional teams to gather and address technical and design requirements.

• Maintain and enhance data models and databases to support new and existing products.

• Monitor and troubleshoot operational or data issues in the data pipelines.

• Continuously improve systems and processes by integrating new tools and technologies.

• Document all data engineering procedures and solutions for future reference and compliance.

• Support data management team in daily operations and long-term projects

Requirements:

. Expertise in AWS services such as S3, EC2, RDS, Redshift, and AWS Glue.

• Proficiency in Python, with a good understanding of libraries for data engineering such as Pandas and PySpark.

• Strong command of SQL for creating, managing, and optimizing data structures and complex queries.

• Familiarity with orchestration tools like Airflow and data integration techniques.

• Understanding of data warehousing solutions and ETL processes.

• Knowledge of data modeling and database design.

• Ability to write clean, maintainable code, adhering to best practices in code quality and security.

• Experience with CI/CD pipelines for data operations in an AWS environment is a plus.

• Good grasp of Agile methodologies and project management practices.

QUALIFICATIONS:

• Minimum of 3 years of experience in data engineering or a related field.

• Strong proficiency in building and maintaining data pipelines in AWS environments.

• Experience with Python for scripting and data manipulation.

• Advanced SQL knowledge for complex querying and database interaction.

• Bachelor’s degree in computer science, Engineering, or a related field is preferred; equivalent practical experience is also considered.

• Demonstrated ability to design and implement effective data solutions in cloud environments.

About Us

RELX is a global provider of information-based analytics and decision tools for professional and business customers. We help scientists make new discoveries, doctors and nurses improve the lives of patients and lawyers win cases. We prevent online fraud and money laundering and help insurance companies evaluate and predict risk. Our events enable customers to learn about markets, source products and complete transactions. In short, we enable our customers to make better decisions, get better results and be more productive. The Group serves customers in more than 180 countries and has offices in about 40 countries. It employs over 33,000 people, of which around 1/4th are technologists.

We want RELX to be a great place to work, where our employees feel valued, have equal opportunities and benefit from pay equality, regardless of their gender, gender identity, national origin, race, ethnicity, religion, sexual orientation, age or disability status. Inclusion and diversity are important to our future. We need the engagement of people from a wide range of backgrounds, experiences and ideas to achieve real innovation for our customers around the world.

About LexisNexis

We help lawyers win cases, manage their work more efficiently, serve their clients better and grow their practices. We assist corporations in better understanding their markets and monitoring relevant news. We partner with leading global associations and customers to help advance the Rule of Law across the world.

Every day at LexisNexis, you will work with highly creative minds to explore impossibilities, inspire innovation, and lead the way 21st century legal content is produced, disseminated, and utilised. You have the power to empower those in need and truly make a difference to the lives of people all around the world.

  • AWS Data Engineer

    2 days ago

    chennai, India RELX Full time

    About the role The role in focus involves designing and implementing robust data pipelines utilizing AWS, Python, and SQL to underpin product analytics and decision-making. As a data engineer, you'll ensure the integrity and performance of data processing and storage systems, optimize data flows within AWS for enhanced performance, and develop efficient...

  • AWS Data Engineer

    2 days ago

    Chennai, India RELX India (Pvt) Ltd L&P div Company Full time

    About the role The role in focus involves designing and implementing robust data pipelines utilizing AWS, Python, and SQL to underpin product analytics and decision-making. As a data engineer, you'll ensure the integrity and performance of data processing and storage systems, optimize data flows within AWS for enhanced performance, and develop efficient...

  • Data Engineer

    2 months ago

    chennai, India Notus Full time

    AWS Data Engineer Job Title: AWS Data Engineer Location: Bangalore / Chennai Experience: 8+ Years Job Description:We are seeking an experienced AWS Data Engineer to join our dynamic team. The ideal candidate will be proficient in designing, implementing, and maintaining data solutions on AWS cloud platform. This role requires expertise in AWS services,...

  • AWS Data Engineer

    3 weeks ago

    Chennai, India LexisNexis Full time

    Software Engineer IIIDo you enjoy designing analytic solutions at an enterprise scale for global customers?Do you have experience in working on complex problems?About our TeamOur product analytics team focuses on using data to understand and enhance the user experience of our customer facing products. We gather and analyze user interaction data from various...

  • AWS Data Engineer

    3 weeks ago

    chennai, India LexisNexis Full time

    Software Engineer III Do you enjoy designing analytic solutions at an enterprise scale for global customers? Do you have experience in working on complex problems? About our Team Our product analytics team focuses on using data to understand and enhance the user experience of our customer facing products. We gather and analyze user interaction data...

  • Data Engineer Python, AWS

    1 week ago

    chennai, India Virtusa Full time

    Data Engineer Python, AWS - CREQ188952 Description Skillset required for this project : Python, AWS, Starbust, Neo4jRoles and Responsibilities : Data Engineer Role1. Data Pipeline Development: Design, build, and maintain scalable data pipelines in AWS Glue using Python code language to ingest, transform, and load data from sources (AWS S3 bucket) into data...

  • Data Engineer

    4 weeks ago

    Bangalore/Chennai, India Notus Full time

    AWS Data Engineer Job Title: AWS Data Engineer Location: Bangalore / Chennai Experience: 8+ Years Job Description:We are seeking an experienced AWS Data Engineer to join our dynamic team. The ideal candidate will be proficient in designing, implementing, and maintaining data solutions on AWS cloud platform. This role requires expertise in AWS services,...

  • Data Engineer

    1 month ago

    Bangalore/Chennai, Tamil Nadu, India Notus Full time

    AWS Data EngineerJob Title: AWS Data EngineerLocation: Bangalore / ChennaiExperience: 8+ YearsJob Description:We are seeking an experienced AWS Data Engineer to join our dynamic team. The ideal candidate will be proficient in designing, implementing, and maintaining data solutions on AWS cloud platform. This role requires expertise in AWS services, Kafka,...

  • AWS Data Engineer

    2 days ago

    Chennai, India HTC Global Services Full time

    AWS Data EngineerExperience: 5+ yearsLocation: Chennai Notice Period: Immediate to 30 daysJob Description: Bachelors or master’s in software engineering, Computer Science, or other relevant disciplinesStrong Knowledge in SQL and Python v3.x LanguageCan analyse new source data, model entities, and write complex SQL.Minimum 5 years of Overall Development...

  • AWS Data Engineer

    1 day ago

    Chennai, India HTC Global Services Full time

    AWS Data EngineerExperience: 5+ yearsLocation: Chennai Notice Period: Immediate to 30 daysJob Description: Bachelors or master’s in software engineering, Computer Science, or other relevant disciplinesStrong Knowledge in SQL and Python v3.x LanguageCan analyse new source data, model entities, and write complex SQL.Minimum 5 years of Overall Development...

  • AWS Data Engineer

    1 month ago

    Chennai, India CliqHR Full time

    Job Description :- Must have minimum 5+ years of experience as AWS Data EngineerNice to have : AWS Certified Data Analytics Specialty certification- Experience in designing and implementing data pipelines using AWS Glue and orchestration using Airflow for batch, streaming (Kafka/Kinesis) and API ingestion patterns- Work closely with DevOps engineer to...

  • AWS Data Engineer

    1 month ago

    Chennai, India CliqHR Full time

    Job Description : - Must have minimum 5+ years of experience as AWS Data EngineerNice to have : AWS Certified Data Analytics Specialty certification- Experience in designing and implementing data pipelines using AWS Glue and orchestration using Airflow for batch, streaming (Kafka/Kinesis) and API ingestion patterns- Work closely with DevOps engineer to...

  • AWS Data Engineer

    1 month ago

    Chennai, Tamil Nadu, India CliqHR Full time

    Job Description :- Must have minimum 5+ years of experience as AWS Data EngineerNice to have : AWS Certified Data Analytics Specialty certification- Experience in designing and implementing data pipelines using AWS Glue and orchestration using Airflow for batch, streaming (Kafka/Kinesis) and API ingestion patterns- Work closely with DevOps engineer to...

  • AWS Data Engineer

    5 days ago

    Chennai, India CliqHR Full time

    Job Description : - AWS, Python, SQL, Spark (with and with snowflake and databricks) AWS DE- AWS, Python, SQL, Spark- Bachelor's degree in Computer Science, Information Technology, or a related field.- 4-8 years of professional experience in data engineering or a related role.- Strong expertise in AWS services (e.g., S3, Redshift, Glue, Lambda).-...

  • AWS Data Engineer

    6 days ago

    chennai, India CliqHR Full time

    Job Description : - AWS, Python, SQL, Spark (with and with snowflake and databricks) AWS DE- AWS, Python, SQL, Spark- Bachelor's degree in Computer Science, Information Technology, or a related field.- 4-8 years of professional experience in data engineering or a related role.- Strong expertise in AWS services (e.g., S3, Redshift, Glue, Lambda).- Proficient...

  • AWS Data Engineer

    6 days ago

    Chennai, India CliqHR Full time

    Job Description :- AWS, Python, SQL, Spark (with and with snowflake and databricks) AWS DE- AWS, Python, SQL, Spark- Bachelor's degree in Computer Science, Information Technology, or a related field.- 4-8 years of professional experience in data engineering or a related role.- Strong expertise in AWS services (e.g., S3, Redshift, Glue, Lambda).-...

  • AWS Data Engineer

    7 hours ago

    Chennai, Tamil Nadu, India CliqHR Full time

    Job Description :- AWS, Python, SQL, Spark (with and with snowflake and databricks) AWS DE- AWS, Python, SQL, Spark- Bachelor's degree in Computer Science, Information Technology, or a related field.- 4-8 years of professional experience in data engineering or a related role.- Strong expertise in AWS services (e.g., S3, Redshift, Glue, Lambda).-...

  • Senior Data Engineer( AWS Redshift)

    2 months ago

    chennai, India Anicalls (Pty) Ltd Full time

    Candidate should have:Clear, concise communication abilities - writing, verbal, presentation - to all levels of technical and non-technical audiences with the ability to collaborateStrong experience in CICD technologies including Python, SQL, Airflow, and Git in a cloud settingUnderstanding of ELK stack is a plus for logging and reporting purposesExperience...

  • Data Engineer(Pyspark, AWS and SQL)

    2 months ago

    chennai, India Virtusa Full time

    Data Engineer(Pyspark, AWS and SQL) - CREQ186019 Description 4-6 years work experience in Software Engineering especially in professional software product development.Expertise in AWS and python coding.Flexible to learn and work for any programming language based on need.Proficient in pipeline for file loading from multiple different sources having different...

  • AWS Data Engineer

    5 days ago

    Chennai, India Ilink Systems Pvt Ltd Full time

    Job Description :- AWS Data Engineer with min of 5 to 7 years of experience.- Collaborate with business analysts to understand and gather requirements for existing or new ETL pipelines.- Connect with stakeholders daily to discuss project progress and updates.- Work within an Agile process to deliver projects in a timely and efficient manner.- Design and...