Data Engineer

1 month ago

Chennai, India QUESS Full time

Job Description :


We are hiring for On-Premise Data Engineer for Bangalore location.


Job Summary :


We are looking for a skilled On-Premise Data Engineer to join our team. The ideal candidate will have experience in designing, developing, and maintaining scalable data pipelines, data lakes, and databases on on-premise infrastructure. You will work closely with data scientists, analysts, and other stakeholders to ensure efficient data processing and availability across the organization.


Requirements :


- Experience with on-premise databases and data warehouses SQL Server, Oracle.

- Strong knowledge of ETL.

- Proficiency in scripting languages : Python, Shell for automating data pipelines. (MUST)

- Experience with data processing frameworks (e.g., Apache Hadoop, Apache Spark) in an on-premise environment.

- Familiarity with batch (real-time data processing technologies is plus).

- Proficiency in SQL and ability to optimize complex queries.

- Knowledge of data modeling and schema design principles.

- Understanding of data governance, data security, and compliance requirements.

- Experience in performance tuning of databases and ETL processes.

- Strong problem-solving skills and ability to troubleshoot complex data issues.

- Familiarity with version control systems (e.g., Git) and CI/CD tools for data pipeline deployment.

- Knowledge of containerization (e.g., Docker) (MUST) and on-prem orchestration (Cron Jobs) is added advantage

Key Responsibilities :

1. Data Infrastructure Design and Management :

- Design, build, and maintain on-premise data pipelines, ETL processes, and data integration frameworks.

- Set up and manage on-premise databases, data warehouses, and data lakes.

- Ensure optimal performance of data architecture by maintaining high data throughput, low-latency, and reliable data delivery.

2. Data Integration and ETL :

- Develop and maintain ETL (Extract, Transform, Load) processes to ingest data from multiple sources into on-premise systems.

- Perform data integration tasks and synchronize data from various sources like relational databases, flat files, APIs, and other enterprise systems.

- Automate and optimize ETL pipelines to process large volumes of structured and unstructured data.

3. Data Quality and Governance :

- Implement data quality checks to ensure accuracy, integrity, and consistency of the data.

- Ensure adherence to data governance policies and standards, including data security and access control.

4. Database Management :

- Set up and manage relational database : SQL Server, Oracle on-premise.

- Tune database performance and optimize queries for better efficiency and reduced downtime.

5. Data Modeling and Architecture :

- Design and maintain data models, schemas, and optimized data structures for high-performance querying and storage.

- Collaborate with data architects and business stakeholders to create efficient data models that support various business use cases.

6. Monitoring and Troubleshooting :

- Monitor and manage on-premise data infrastructure for availability, performance, and capacity.

- Troubleshoot any issues related to data ingestion, processing, and storage.

7. Collaboration :

a. Soft Skills :

- Strong communication and collaboration skills.

- Ability to work independently and within a team.

- Analytical mindset and detail-oriented approach to problem-solving

(ref:hirist.tech)

  • Senior Data Engineer

    2 months ago

    chennai, India Wavicle Data Solutions Full time

    We are seeking an experienced Senior AWS Data Engineer to join our team. The ideal candidate will have a strong background in designing, building, and maintaining scalable data pipelines and solutions on AWS. You will work closely with data scientists, analysts, and cross-functional teams to optimize and manage our data infrastructure. This role requires a...

  • Senior Data Engineer

    1 month ago

    Chennai, India Wavicle Data Solutions Full time

    We are seeking an experienced Senior AWS Data Engineer to join our team. The ideal candidate will have a strong background in designing, building, and maintaining scalable data pipelines and solutions on AWS. You will work closely with data scientists, analysts, and cross-functional teams to optimize and manage our data infrastructure. This role requires a...

  • Chief Data Science Engineer

    4 weeks ago

    Chennai, Tamil Nadu, India NTT DATA Full time

    Job SummaryWe are seeking an experienced Chief Data Science Engineer to join our team at NTT DATA. As a key member of our organization, you will be responsible for designing and implementing machine learning systems, researching and developing ML algorithms and tools, and selecting appropriate data sets.About the RoleYou will work closely with...

  • Senior Data Engineer

    2 months ago

    Chennai, India Wavicle Data Solutions Full time

    We are seeking an experienced Senior AWS Data Engineer to join our team. The ideal candidate will have a strong background in designing, building, and maintaining scalable data pipelines and solutions on AWS. You will work closely with data scientists, analysts, and cross-functional teams to optimize and manage our data infrastructure. This role requires a...

  • Senior Data Engineer

    2 months ago

    Chennai, India Wavicle Data Solutions Full time

    We are seeking an experienced Senior AWS Data Engineer to join our team. The ideal candidate will have a strong background in designing, building, and maintaining scalable data pipelines and solutions on AWS. You will work closely with data scientists, analysts, and cross-functional teams to optimize and manage our data infrastructure. This role requires a...

  • Senior Data Engineer

    2 months ago

    chennai, India Wavicle Data Solutions Full time

    We are seeking an experienced Senior AWS Data Engineer to join our team. The ideal candidate will have a strong background in designing, building, and maintaining scalable data pipelines and solutions on AWS. You will work closely with data scientists, analysts, and cross-functional teams to optimize and manage our data infrastructure. This role requires a...

  • Senior Data Engineer

    2 months ago

    Chennai, India Wavicle Data Solutions Full time

    We are seeking an experienced Senior AWS Data Engineer to join our team. The ideal candidate will have a strong background in designing, building, and maintaining scalable data pipelines and solutions on AWS. You will work closely with data scientists, analysts, and cross-functional teams to optimize and manage our data infrastructure. This role requires a...

  • Senior Data Engineer

    1 month ago

    Chennai, Tamil Nadu, India Wavicle Data Solutions Full time

    We are seeking an Experienced AWS Data Architect with a strong background in designing, building, and maintaining scalable data pipelines and solutions on AWS. The ideal candidate will have a deep understanding of AWS services, data engineering best practices, and cloud architecture.Key Responsibilities:Design, develop, and maintain robust ETL pipelines on...

  • Cybersecurity Engineer for NTT DATA

    4 weeks ago

    Chennai, Tamil Nadu, India NTT DATA Full time

    Company OverviewNTT DATA is a $30+ billion trusted global innovator of business and technology services. We serve 75% of the Fortune Global 100 and are committed to helping clients innovate, optimize and transform for long-term success.We invest over $3.6 billion each year in R&D to help organizations and society move confidently and sustainably into the...

  • Engineer (L1) - Titus Data Classification

    1 month ago

    Chennai, India NTT DATA Full time

    Job Description Make an impact with NTT DATAJoin a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion – it’s a place where you can grow, belong and thrive.Your day at NTT...

  • Artificial Intelligence Engineer

    2 weeks ago

    Chennai, Tamil Nadu, India NTT DATA Full time

    Are you a seasoned AI expert looking to make a significant impact at a leading global innovator in business and technology services?We are seeking a highly skilled Artificial Intelligence Engineer to join our team at NTT DATA. This role offers the opportunity to design, develop, and test software systems, modules, or applications for software enhancements...

  • Crayon Data | Senior Software Engineer | chennai

    4 weeks ago

    chennai, India Crayon Data Full time

    Role: Senior Software Engineer – Backend Experience level: 5+ years Location: Hybrid Who are we? ​ Crayon Data is a leading provider of AI-led revenue acceleration solutions, headquartered in Singapore with a local presence in India and the UAE. The company was founded in 2012 with the vision of simplifying the world’s choices. Our flagship...

  • Crayon Data | Senior Software Engineer | chennai

    4 weeks ago

    chennai, India Crayon Data Full time

    Role: Senior Software Engineer – BackendExperience level: 5+ yearsLocation: HybridWho are we?​Crayon Data is a leading provider of AI-led revenue acceleration solutions, headquartered in Singapore with a local presence in India and the UAE. The company was founded in 2012 with the vision of simplifying the world’s choices. Our flagship platform,...

  • Crayon Data | Senior Software Engineer | chennai

    4 weeks ago

    chennai, India Crayon Data Full time

    Role: Senior Software Engineer – Backend Experience level: 5+ years Location: Hybrid Who are we? ​ Crayon Data is a leading provider of AI-led revenue acceleration solutions, headquartered in Singapore with a local presence in India and the UAE. The company was founded in 2012 with the vision of simplifying the world’s choices. Our flagship...

  • Senior Machine Learning Engineer

    1 week ago

    Chennai, Tamil Nadu, India Crayon Data Full time

    We are seeking a highly skilled Senior Machine Learning Engineer to join our team in Chennai. This is a fantastic opportunity to work on large scale data solutions using machine learning, operation research and pattern searching methods.About Crayon DataCrayon Data is a leading provider of AI-led revenue acceleration solutions, headquartered in Singapore...

  • Bastion Data Solutions | Cloud SRE Architect

    2 weeks ago

    Chennai, India Bastion Data Solutions Full time

    Company DescriptionBastion data solutions..Role DescriptionThis is a full-time on-site role for a Cloud SRE Architect / DevOps Engineer at Bastion Data Solutions in Chennai. The role involves day-to-day tasks such as Site Reliability Engineering, troubleshooting, software development, system administration, and infrastructure management.QualificationsSite...

  • Bastion Data Solutions | Cloud SRE Architect

    2 weeks ago

    chennai, India Bastion Data Solutions Full time

    Company DescriptionBastion data solutions..Role DescriptionThis is a full-time on-site role for a Cloud SRE Architect / DevOps Engineer at Bastion Data Solutions in Chennai. The role involves day-to-day tasks such as Site Reliability Engineering, troubleshooting, software development, system administration, and infrastructure management.QualificationsSite...

  • Bastion Data Solutions | Cloud SRE Architect

    2 weeks ago

    chennai, India Bastion Data Solutions Full time

    Company DescriptionBastion data solutions.. Role DescriptionThis is a full-time on-site role for a Cloud SRE Architect / DevOps Engineer at Bastion Data Solutions in Chennai. The role involves day-to-day tasks such as Site Reliability Engineering, troubleshooting, software development, system administration, and infrastructure management. QualificationsSite...

  • Bastion Data Solutions | Cloud SRE Architect

    2 weeks ago

    chennai, India Bastion Data Solutions Full time

    Company DescriptionBastion data solutions..Role DescriptionThis is a full-time on-site role for a Cloud SRE Architect / DevOps Engineer at Bastion Data Solutions in Chennai. The role involves day-to-day tasks such as Site Reliability Engineering, troubleshooting, software development, system administration, and infrastructure management.QualificationsSite...

  • Bastion Data Solutions | Cloud SRE Architect

    1 week ago

    chennai, India Bastion Data Solutions Full time

    Company DescriptionBastion data solutions..Role DescriptionThis is a full-time on-site role for a Cloud SRE Architect / DevOps Engineer at Bastion Data Solutions in Chennai. The role involves day-to-day tasks such as Site Reliability Engineering, troubleshooting, software development, system administration, and infrastructure management.QualificationsSite...