Data Engineer

5 days ago

tamil nadu, India Talent Corner HR Services Pvt Ltd Full time

JOB OBJECTIVE


We are seeking a dynamic professional to fill in our Data Engineering role who will be responsible for designing, developing, and maintaining the data architecture, infrastructure, and pipelines that enable to collect, store, process, and analyze large volumes of data. This role will play a crucial part in ensuring data availability, quality, and accessibility for data-driven decision-making.



KEY ACCOUNTABILITIES


• Data Pipeline Development: o Design, develop, and maintain data pipelines to ingest, process, and transform data from various sources into usable formats. o Implement data integration solutions that connect disparate data systems, including databases, APIs, and third-party data sources.


• Data Storage and Warehousing:

Create and manage data storage solutions, such as data lakes, data warehouses, and NoSQL databases.

Optimize data storage for performance, scalability, and cost-efficiency.


Data Quality and Governance: o Establish data quality standards and implement data validation and cleansing processes.

o Collaborate with data analysts and data scientists to ensure data consistency and accuracy.


ETL (Extract, Transform, Load):

o Develop ETL processes to transform raw data into a structured and usable format.

o Monitor and troubleshoot ETL jobs to ensure data flows smoothly.


Performance Tuning:

o Optimize data pipelines and queries for improved performance and efficiency.

o Identify and resolve bottlenecks in data processing.

• Data Documentation:

o Maintain comprehensive documentation for data pipelines, schemas, and data dictionaries.

o Create and update data lineage and metadata documentation.


Scalability and Reliability:

o Design data infrastructure to scale with growing data volumes and business requirements.

o Implement data recovery and backup strategies to ensure data availability and resilience.

• Collaboration:

o Collaborate with cross-functional teams, including data scientists, analysts, and business stakeholders, to understand data requirements and deliver data solutions.


o Provide technical support and guidance to data users.

• Continuous Learning:

o Stay updated on emerging technologies, tools, and best practices in data engineering.

o Implement new technologies to enhance data processing capabilities.


QUALIFICATIONS, EXPERIENCE, & COMPETENCIES

• 9+ years of experience in similar role

• Bachelor's or master’s degree in computer science, Information Technology, or a related field.

• Proven experience in data engineering, ETL development, and data integration.

• Proficiency in data pipeline orchestration tools (e.g., Apache NiFi, Apache Airflow).

• Strong knowledge of databases (SQL and NoSQL), data warehousing, and data modeling concepts.

• Familiarity with data processing frameworks (e.g., Hadoop, Spark) and cloud-based data services (e.g., AWS, Azure, GCP).

• Experience with version control systems (e.g., Git) and data versioning.

• Excellent programming skills in languages such as Python, SQL, Java, Scala, R, and/or Go.

• Knowledge of data security and compliance standards.

• Strong problem-solving and troubleshooting skills.

• Effective communication and teamwork abilities.



Interviews in Chennai –

Positions: Python /java /data engineer/ fronted developer

Interview Dates: (20th September Saturday)

Years of experience - 4-12 Years

Preferences – previous experience in BFSI, NBFC, MFI or in fintech organization.

Venue: will be informed shortly (Chennai)

Eligibility Criteria: BE/ B. Tech only.


sahiba

8296043355

  • Senior Data Engineer

    5 days ago

    tamil nadu, India Eucloid Data Solutions Full time

    Job DescriptionEucloid is looking for a skilled Data Engineer to join our team and contribute to the design, development, and optimization of data frameworks pipelines using Python, Elasticsearch, SQL DB and Queue System. The ideal candidate will have a strong technical background, a passion for solving complex problems, and experience in building scalable...

  • Data & Business Insights Associate

    1 week ago

    Chennai, Tamil Nadu, India NTT DATA Full time

    Data Business Insights Associate Summary NTTDATA Services are seeking Data Business Insights Associate with basic understanding of data and reporting They will also work with data analysts and automation experts to create new visuals and features that support business intelligence initiatives Accountabilities Understand Gathering and Prepare the...

  • Data Engineer

    1 week ago

    tamil nadu, India Impetus Career Consultants Full time

    HIRING FOR A USA BASED MNC -Location - Chennai Experience : 3-10years Data Engineer T3Bachelor’s or master’s degree with 3+ years of experience in Computer Science, Data Science, Engineering, or a related field.3+ years of experience in working with Python, SQL, PySpark and bash scripts. Proficient in software development lifecycle and software...

  • Data Engineer

    1 week ago

    tamil nadu, India LTIMindtree Full time

    We are hiring for AWS Data EngineerExperience - 5 to 7 YearsLocation : Chennai Notice period - immediate to 30 daysJob SummarySeeking a Specialist with 5 to 7 years of experience in AWS IoT Data Engineering and strong Python skills to design and implement scalable IoT data solutions4 years of experience in GCP BQ Dataflow Airflow and Python Should have hands...

  • Data Engineer

    1 week ago

    tamil nadu, India Impetus Full time

    Skills: Bigdata, Pyspark, Python ,Hadoop / HDFS; Spark; Good to have : GCP/any cloud Roles/Responsibilities:Develops and maintains scalable data pipelines to support continuing increases in data volume and complexity.Collaborates with analytics and business teams to improve data models that feed business intelligence tools, increasing data accessibility and...

  • Data Engineer

    1 day ago

    tamil nadu, India HCLTech Full time

    Azure Data Lead with Azure Data Factory (ADF),Azure Databricks,Job SummaryThe Technical Lead will be responsible for overseeing and leading projects related to Azure Data Factory (ADF), Azure Databricks, SQL, Oracle PL/SQL, and Python. The role involves designing, developing, and implementing data solutions while ensuring they meet the business requirements...

  • Data Engineering

    1 day ago

    tamil nadu, India EXL Full time

    Responsibilities:Work with stakeholders to understand the data requirements to design, develop, and maintain complex ETL processes.Create the data integration and data diagram documentation. Lead the data validation, UAT and regression test for new data asset creation.Create and maintain data models, including schema design and optimization.Create and manage...

  • Quality Engineer

    1 day ago

    tamil nadu, India Tiger Analytics Full time

    As a Quality Engineer - Data, you will be involved in every phase of SDLC and focus on Functional testability, Automation and Performance of the software. More specifically, you will work on:Selecting and integrating Data tools and frameworks required to provide requested capabilities.Technical guidance for software engineers engaged in the design, coding,...

  • Data Architect

    1 week ago

    tamil nadu, India Capgemini Engineering Full time

    Data Architect / Data EngineerLocation: ChennaiExperience: 4–6 yearsYour RoleAs a Data Architect / Data Engineer, you will be responsible for creating and maintaining digital twin models and integrating real-time data streams to support simulation and analytics in maritime systems. You will work with advanced tools and platforms to build scalable,...

  • Data Engineer

    1 week ago

    tamil nadu, India Persistent Systems Full time

    About Position: We are conducting an in-person hiring drive for the position of Data Engineer (Pyspark, Power BI) Engineer in Chennai on 6th Sep 2025. Interview Location is mentioned below:Chennai: Olympia Pinnacle, #1, S. No. 69/2A1, S. No. 67/1-2A, New S. No. 67/4, Old Mahabalipuram Road, Okkiam Thuraipakkam Village, Thuraipakkam, Chennai, Tamilnadu...