Senior Data Engineer

3 days ago

Bengaluru, Karnataka, India JRD Systems Full time

We are seeking a highly skilled and motivated Senior Data Engineer to work on complex data-driven projects at JRD Systems. The ideal candidate will have deep knowledge of data manipulation, advanced algorithm development, and experience with handling large datasets efficiently.

Key Responsibilities:

  • Design, develop, and maintain complex data pipelines and workflows using Python and SQL.
  • Utilize Pandas for advanced data transformation, including filtering, sorting, grouping, merging datasets, concatenating dataframes, and handling missing or duplicate data.
  • Write and optimize complex SQL queries involving Joins, Group By, Order By, and aggregate filtering for large-scale datasets.
  • Develop scalable data pipelines and algorithms to process and analyze large datasets efficiently.
  • Build and integrate APIs for data ingestion, transformation, and delivery as part of project requirements.
  • Collaborate with data scientists, analysts, and other stakeholders to understand data needs and translate them into actionable solutions.
  • Monitor and improve the performance of data pipelines, ensuring accuracy and reliability of data systems.
  • Implement and enforce data quality standards to ensure data consistency and integrity.
  • Explore opportunities to optimize processes by leveraging AWS services (preferred) and other cloud technologies.

Requirements:

  • Bachelor's degree in computer science, engineering, data science, or a related field.
  • 6+ years of professional experience in data engineering or related roles.
  • Proficient in Python programming with hands-on experience in libraries like Pandas for data transformation and manipulation.
  • Expertise in handling operations such as filtering, sorting, grouping, pivoting, merging datasets, concatenating dataframes, handling missing data, dropping duplicates, and aggregating large datasets.
  • Advanced skills in SQL with a focus on Joins, Group By, Order By, subqueries, aggregate functions, and query optimization for large datasets.
  • Strong understanding of data modeling and database design principles.
  • Ability to design scalable data pipelines for processing large datasets.
  • Experience with API development and integration

The estimated salary for this position is $120,000 per year, based on industry standards and location. We offer competitive benefits, including health insurance, retirement plans, and paid time off. If you are passionate about data engineering and building robust solutions, we would like to hear from you.

  • Senior Data Engineering Manager

    3 days ago

    Bengaluru, Karnataka, India Data Labs - LANDMARK GROUP Full time

    About the RoleWe are seeking a Senior Data Engineering Manager to lead our engineering team in successfully building and deploying cutting-edge analytics products for consumption by various stakeholders.As a key member of our team, you will be responsible for leading the architecture, design, and delivery of enterprise-grade microservices. You will also...

  • Senior Data Engineer for AI and Machine Learning

    1 week ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Job Title: Senior Data Engineer for AI and Machine LearningWe are seeking an experienced Data Scientist & AIML, GenAI Lead/Engineer to join our team in Bangalore, India.About the Role:Develop and implement traditional machine learning algorithms.Deploy at least one model in a production environment.Write and maintain Python code for data science and machine...

  • Senior Time Series Data Engineer

    3 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time

    About the RoleWe are seeking a highly skilled Senior Time Series Data Engineer to join our team in Bangalore, India. As a Senior Time Series Data Engineer, you will be responsible for designing, developing, and implementing large-scale data processing systems that handle complex time series data.Key ResponsibilitiesDesign and develop scalable data pipelines...

  • Senior AI Data Engineer and Solutions Architect

    3 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time

    About NTT DATANTT DATA is a global innovator of business and technology services, serving 75% of the Fortune Global 100. Our diverse experts in over 50 countries collaborate to drive long-term success for clients.Job OverviewWe are seeking an experienced Senior AI Data Engineer and Solutions Architect to join our team in Bangalore, India. This role requires...

  • Senior Data Architect

    2 weeks ago

    Bengaluru, Karnataka, India NTT DATA Services Full time

    Job OverviewWe are seeking an experienced Senior Data Architect - Cloud Engineer to join our team in Remote India. The successful candidate will play a critical role in supporting and enhancing our Azure Data Lakehouse environment.About the RoleThis is an exciting opportunity to leverage your expertise in designing and implementing efficient data models,...

  • Senior Cloud Data Architect

    3 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time

    NTT DATA is a global technology services company with a presence in over 50 countries.We have a wide range of job opportunities available for talented professionals like you.About the Job:Job DescriptionWe are seeking a Senior Cloud Data Architect to join our team in Bangalore, India. The successful candidate will be responsible for designing and...

  • Senior Power BI Data Engineer Professional

    2 weeks ago

    Bengaluru, Karnataka, India NTT DATA Services Full time

    Job OverviewWe are seeking a highly skilled Senior Power BI Data Engineer to join our team in Bangalore, India. This role will involve developing and implementing data engineering solutions using Power BI reporting tools.About the RoleThis is an exciting opportunity for an experienced data engineer to work with our team and contribute to the development of...

  • Snowflake Data Engineer and Architect

    4 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time

    About the RoleWe are seeking a highly skilled Snowflake Data Engineer and Architect to join our team in Bangalore, India. This is a senior-level position that requires expertise in designing, developing, and maintaining large-scale data warehousing solutions using Snowflake.Key ResponsibilitiesDesign and implement efficient data models and architectures for...

  • Senior Engineering Manager

    1 month ago

    Bengaluru, Karnataka, India HEVO DATA Full time

    Job Description:This is an excellent opportunity to lead the development of scalable and fault-tolerant platform services at Hevo Data.As a Senior Engineering Manager, you will be responsible for building and managing a team of passionate software engineers who share a sense of ownership and impact.The successful candidate will drive on-time, high-quality...

  • Senior Voice Systems Engineer

    1 week ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Job OverviewWe are seeking a seasoned Senior Voice Systems Engineer to join our team in Bangalore, India.About the RoleThis is a critical position that requires expertise in design, deployment, and support of voice platforms. As a Senior Voice Systems Engineer, you will be responsible for managing business-driven programs and projects across voice products...

  • Senior Cloud Data Architect

    4 weeks ago

    Bengaluru, Karnataka, India NTT DATA Services Full time

    About the RoleWe are seeking an experienced Senior Cloud Data Architect to join our team at NTT DATA Services. As a key member of our data engineering team, you will be responsible for designing and implementing cloud-based data solutions on Azure Data platform.ResponsibilitiesDesign and develop big data processing notebooks using Azure DatabricksScripting...

  • Data Engineering Expert

    3 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time

    About the RoleWe are seeking a skilled Data Engineer to join our team in Bangalore, India. As a key member of our data engineering team, you will play a crucial role in designing and implementing automated data pipelines.

  • Senior Data Solutions Consultant

    2 days ago

    Bengaluru, Karnataka, India HEVO DATA Full time

    Overview: We're seeking a skilled Senior Data Solutions Consultant to join our Sales team. This role involves working closely with the sales team to understand customers' business and technical needs and demonstrating how Hevo's platform can address their real-time data replication requirements.

  • Senior Quality Assurance Engineer

    2 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time

    About the Role">NTT DATA Services is a leading provider of IT and business services, with a strong presence in global markets. As part of our team, you will have the opportunity to work on cutting-edge projects that drive innovation and growth.Job OverviewWe are currently seeking a skilled Senior Quality Assurance Engineer to join our team in Bangalore,...

  • Senior Data Architect

    4 weeks ago

    Bengaluru, Karnataka, India NTT DATA Services Full time

    About the RoleNTT DATA Services is seeking a highly skilled Senior Data Architect to join our team in Bangalore, India.The Ideal CandidateThis is an exceptional opportunity for an experienced data professional to work with cutting-edge technologies and contribute to the design and development of innovative solutions. To be successful in this role, you will...

  • Senior Software Engineer for Enterprise Solutions

    2 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time

    About the RoleWe are seeking a highly skilled Senior Software Engineer to join our team in Bangalore, India. This is a unique opportunity to work on cutting-edge projects and contribute to the growth of our organization.As a Senior Software Engineer, you will be responsible for designing and developing web applications using the .NET framework, VB.NET, Win...

  • Senior Data Engineer

    1 week ago

    Bengaluru, Karnataka, India Kloud9 Full time

    Job Description for Senior Data EngineerCompany OverviewKloud9 is a dynamic and innovative company that requires a skilled Senior Data Engineer to join our team. As a Senior Data Engineer, you will play a key role in designing, developing, and maintaining our data pipelines and ETL processes.ResponsibilitiesCollaborate with cross-functional teams to...

  • Senior Data Engineer

    2 days ago

    Bengaluru, Karnataka, India Mouri Tech (P) Ltd Full time

    Job Title: Senior Data EngineerAbout Mouri Tech (P) LtdMouri Tech (P) Ltd is a leading technology company that requires experienced data engineers to drive our business growth. We are seeking a skilled Senior Data Engineer to join our team and help us develop innovative data-driven solutions.Salary: ₹1,200,000 - ₹2,500,000 per annumJob Description:We are...

  • Senior Software Engineer

    3 weeks ago

    Bengaluru, Karnataka, India NTT DATA Services Full time

    Job OverviewWe are seeking a highly skilled Senior Software Engineer to join our JavaScript and Web Platform engineering practice at NTT DATA Services.

  • Data Engineering Cloud Specialist

    3 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Job Title: Data Engineering Cloud SpecialistAbout the RoleWe are seeking an experienced Data Engineer to join our team at NTT DATA. This is a fantastic opportunity to work on diverse data engineering activities on Azure Data platform and contribute to building a robust data pipeline connecting various enterprise data sources.About YouTo be successful in this...