Data Engineer

4 weeks ago

Chennai, India INXL Digital Full time



JOB OBJECTIVE

We are seeking a dynamic professional to fill in our Data Engineering role who will be responsible for designing, developing, and maintaining the data architecture, infrastructure, and pipelines that enable Northern Arc to collect, store, process, and analyze large volumes of data. This role will play a crucial part in ensuring data availability, quality, and accessibility for data-driven decision-making.

KEY ACCOUNTABILITIES

Data Pipeline Development :

- Design, develop, and maintain data pipelines to ingest, process, and transform data from various sources into usable formats.
- Implement data integration solutions that connect disparate data systems, including databases, APIs, and third-party data sources.

Data Storage and Warehousing :

- Create and manage data storage solutions, such as data lakes, data warehouses, and NoSQL databases.

- Optimize data storage for performance, scalability, and cost-efficiency.

Data Quality and Governance :

- Establish data quality standards and implement data validation and cleansing processes.

- Collaborate with data analysts and data scientists to ensure data consistency and accuracy.

ETL (Extract, Transform, Load) :

- Develop ETL processes to transform raw data into a structured and usable format.

- Monitor and troubleshoot ETL jobs to ensure data flows smoothly.

Data Security and Compliance :

- Implement data security measures and access controls to protect sensitive data.

- Ensure compliance with data privacy regulations and industry standards (e.g., GDPR, HIPAA).

Performance Tuning :

- Optimize data pipelines and queries for improved performance and efficiency.

- Identify and resolve bottlenecks in data processing.

Data Documentation :

- Maintain comprehensive documentation for data pipelines, schemas, and data dictionaries.

- Create and update data lineage and metadata documentation.

Scalability and Reliability :

- Design data infrastructure to scale with growing data volumes and business requirements.

- Implement data recovery and backup strategies to ensure data availability and resilience.

Collaboration :

- Collaborate with cross-functional teams, including data scientists, analysts, and business stakeholders, to understand data requirements and deliver data solutions.

QUALIFICATIONS, EXPERIENCE, & COMPETENCIES :

- 9+ years of experience in similar role

- Bachelor's or masters degree in computer science, Information Technology, or a related field.

- Proven experience in data engineering, ETL development, and data integration.

- Proficiency in data pipeline orchestration tools (e.g., Apache NiFi, Apache Airflow).

- Strong knowledge of databases (SQL and NoSQL), data warehousing, and data modeling concepts.

- Familiarity with data processing frameworks (e.g., Hadoop, Spark) and cloud-based data services (e.g., AWS, Azure, GCP).

- Experience with version control systems (e.g., Git) and data versioning.

- Excellent programming skills in languages such as Python, SQL, Java, Scala, R, and/or Go.

- Knowledge of data security and compliance standards.

- Strong problem-solving and troubleshooting skills.

- Effective communication and teamwork abilities


(ref:hirist.tech)

  • Data Engineer

    1 week ago

    Chennai, India NTT DATA Full time

    Job Description Req ID:     NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer to join our team in Chennai, Tamil Nādu (IN-TN), India (IN). Job Duties: As a data...

  • Data Engineer

    3 weeks ago

    Chennai, India NTT DATA Full time

    Req ID: NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer - Azure to join our team in Chennai, Tamil Nādu (IN-TN), India (IN). "Job Duties: Key Responsibilities: ...

  • Data Engineer

    2 weeks ago

    Chennai, Tamil Nadu, India NTT DATA Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Req ID: 336026NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer - Azure to join our team in Chennai, Tamil Nādu (IN-TN), India (IN). "Job Duties: Key Responsibilities:...

  • Data Engineer

    3 weeks ago

    Chennai, India CX Data Labs Full time

    Hi Role - Azure Data engineer Location - Chennai, Gurugram (5days Onsite) Full time Immediate joiner Only (15days Notice period only) Technical Skills: o Proficiency in SQL for complex queries, database design, and optimization. o Strong experience with PySpark for data transformation and processing. o Hands-on experience with Databricks for building and...

  • Data Engineer

    2 weeks ago

    Chennai, Tamil Nadu, India CX Data Labs Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    HiRole - Azure Data engineerLocation - Chennai, Gurugram (5days Onsite)Full timeImmediate joiner Only (15days Notice period only)Technical Skills:o Proficiency in SQL for complex queries, database design, and optimization.o Strong experience with PySpark for data transformation and processing.o Hands-on experience with Databricks for building and managing...

  • Data Engineer

    2 weeks ago

    Chennai, Tamil Nadu, India CustomerLabs ❤️ 1P Data OPs Full time ₹ 5,00,000 - ₹ 15,00,000 per year

    As a Data Engineer (GCP) at CustomerLabs Inc., you will play a crucial role in designing, developing, and maintaining our data infrastructure on Google Cloud Platform. You will be responsible for ensuring the reliability, scalability, and efficiency of our data pipelines to support our analytics and machine learning initiatives.Key ResponsibilitiesDesign and...

  • Data Engineer

    3 weeks ago

    Chennai, India NTT DATA North America Full time

    Req ID: NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer - Azure to join our team in Chennai, Tamil Nādu (IN-TN), India (IN). "Job Duties: Key Responsibilities: Design...

  • Data Engineer

    2 weeks ago

    Chennai, Tamil Nadu, India NTT DATA North America Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Req ID:336025NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer - Azure to join our team in Chennai, Tamil Nādu (IN-TN), India (IN)."Job Duties: Key...

  • Senior data engineer

    5 days ago

    Chennai, India Eucloid Data Solutions Full time

    Job DescriptionEucloid is looking for a skilled Data Engineer to join our team and contribute to the design, development, and optimization of data frameworks pipelines using Python, Elasticsearch, SQL DB and Queue System. The ideal candidate will have a strong technical background, a passion for solving complex problems, and experience in building scalable...

  • Senior data engineer

    4 days ago

    Chennai, India Eucloid Data Solutions Full time

    Job DescriptionEucloid is looking for a skilled Data Engineer to join our team and contribute to the design, development, and optimization of data frameworks pipelines using Python, Elasticsearch, SQL DB and Queue System. The ideal candidate will have a strong technical background, a passion for solving complex problems, and experience in building scalable...