Data Engineer

3 weeks ago

Chennai, Tamil Nadu, India TalentOrient Pvt. Ltd. Full time

JOB OBJECTIVE :

We are seeking a dynamic professional to fill in our Data Engineering role who will be responsible for designing, developing, and maintaining the data architecture, infrastructure, and pipelines that enable Northern Arc to collect, store, process, and analyze large volumes of data. This role will play a crucial part in ensuring data availability, quality, and accessibility for data-driven decision-making.

KEY ACCOUNTABILITIES :

- Data Pipeline Development :

- Design, develop, and maintain data pipelines to ingest, process, and transform data from various sources into usable formats.

- Implement data integration solutions that connect disparate data systems, including databases, APIs, and third-party data sources.

- Data Storage and Warehousing:

- Create and manage data storage solutions, such as data lakes, data warehouses, and NoSQL databases.

- Optimize data storage for performance, scalability, and cost-efficiency.

- Data Quality and Governance:

- Establish data quality standards and implement data validation and cleansing processes.

- Collaborate with data analysts and data scientists to ensure data consistency and accuracy.

- ETL (Extract, Transform, Load):

- Develop ETL processes to transform raw data into a structured and usable format.

- Monitor and troubleshoot ETL jobs to ensure data flows smoothly.

- Data Security and Compliance:

- Implement data security measures and access controls to protect sensitive data.

- Ensure compliance with data privacy regulations and industry standards (e.g., GDPR, HIPAA).

- Performance Tuning:

- Optimize data pipelines and queries for improved performance and efficiency.

- Identify and resolve bottlenecks in data processing.

- Data Documentation:

- Maintain comprehensive documentation for data pipelines, schemas, and data dictionaries.

- Create and update data lineage and metadata documentation.

- Scalability and Reliability:

- Design data infrastructure to scale with growing data volumes and business requirements.

- Implement data recovery and backup strategies to ensure data availability and resilience.

- Collaboration:

- Collaborate with cross-functional teams, including data scientists, analysts, and business stakeholders, to understand data requirements and deliver data solutions.

- Provide technical support and guidance to data users.

QUALIFICATIONS, EXPERIENCE, & COMPETENCIES

- 9+ years of experience in similar role

- Bachelor's or master's degree in computer science, Information Technology, or a related field.

- Proven experience in data engineering, ETL development, and data integration.

- Proficiency in data pipeline orchestration tools (e.g., Apache NiFi, Apache Airflow).

- Strong knowledge of databases (SQL and NoSQL), data warehousing, and data modeling concepts.

- Familiarity with data processing frameworks (e.g., Hadoop, Spark) and cloud-based data services (e.g., AWS, Azure, GCP).

- Experience with version control systems (e.g., Git) and data versioning.

- Excellent programming skills in languages such as Python, SQL, Java, Scala, R, and/or Go.

- Knowledge of data security and compliance standards.

- Strong problem-solving and troubleshooting skills.

- Effective communication and teamwork abilities.

(ref:hirist.tech)

  • Data Engineer

    4 days ago

    Chennai, Tamil Nadu, India NTT DATA Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Req ID: 336026NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer - Azure to join our team in Chennai, Tamil Nādu (IN-TN), India (IN). "Job Duties: Key Responsibilities:...

  • Data Engineer

    21 hours ago

    Chennai, Tamil Nadu, India CX Data Labs Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    HiRole - Azure Data engineerLocation - Chennai, Gurugram (5days Onsite)Full timeImmediate joiner Only (15days Notice period only)Technical Skills:o Proficiency in SQL for complex queries, database design, and optimization.o Strong experience with PySpark for data transformation and processing.o Hands-on experience with Databricks for building and managing...

  • Data Engineer

    2 weeks ago

    Chennai, Tamil Nadu, India NTT DATA North America Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Req ID: NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer - Azure to join our team in Chennai, Tamil Nādu (IN-TN), India (IN)."Job Duties: Key Responsibilities:•  ...

  • Data Engineer

    3 days ago

    Chennai, Tamil Nadu, India CustomerLabs ❤️ 1P Data OPs Full time ₹ 5,00,000 - ₹ 15,00,000 per year

    As a Data Engineer (GCP) at CustomerLabs Inc., you will play a crucial role in designing, developing, and maintaining our data infrastructure on Google Cloud Platform. You will be responsible for ensuring the reliability, scalability, and efficiency of our data pipelines to support our analytics and machine learning initiatives.Key ResponsibilitiesDesign and...

  • Data Engineer

    4 days ago

    Chennai, Tamil Nadu, India NTT DATA North America Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Req ID:336025NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer - Azure to join our team in Chennai, Tamil Nādu (IN-TN), India (IN)."Job Duties: Key...

  • Data Engineer

    17 hours ago

    Chennai, Tamil Nadu, India NTT DATA Global Delivery Services Ltd Full time ₹ 10,00,000 - ₹ 25,00,000 per year

    Data Engineer - Azure Req ID: 336041 NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer - Azure to join our team in Chennai, Tamil Nādu (IN-TN), India (IN). "Job...

  • GCP Data Engineer

    4 weeks ago

    Chennai, Tamil Nadu, India CustomerLabs 1P Data OPs Full time

    Position Overview:"Yesterday is history, tomorrow is a mystery, but today is a gift. That's why we call itthe present." - Master OogwayJoin CustomerLabs' dynamic data team as a Data Engineer and play a pivotal role intransforming raw marketing data into actionable insights that power our digitalmarketing platform. As a key member of our data infrastructure...

  • Lead Data Engineer

    1 week ago

    Chennai, Tamil Nadu, India AABM Cloud Data Solutions Full time ₹ 12,00,000 - ₹ 18,00,000 per year

    About the RoleWe are seeking a Lead Data Engineer to join our team. In this role, you will be crucial in designing, building, and maintaining our data infrastructure. This is a hands-on position requiring a strong foundation in data warehousing, ETL processes, and database management. The ideal candidate will have a keen eye for detail and the ability to...

  • GCP Data Engineer

    4 days ago

    Chennai, Tamil Nadu, India CustomerLabs ❤️ 1P Data OPs Full time ₹ 8,00,000 - ₹ 18,00,000 per year

    Data Engineer Job DescriptionPosition Overview Yesterday is history, tomorrow is a mystery, but today is a gift. That's why we call it the present.- Master OogwayJoin CustomerLabs' dynamic data team as a Data Engineer and play a pivotal role in transforming raw marketing data into actionable insights that power our digital marketing platform. As a key member...

  • Data Engineer for Azure DevOps

    4 days ago

    Chennai, Tamil Nadu, India NTT DATA Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Req ID: 336023NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer for Azure DevOps to join our team in Chennai, Tamil Nādu (IN-TN), India (IN). "Job Duties: 7+ years of...