Data Engineer

3 weeks ago

Chennai Tamil Nadu India, Tamil Nadu Talent Corner HR Services Pvt Ltd Full time

JOB OBJECTIVEWe are seeking a dynamic professional to fill in our Data Engineering role who will be responsible for designing, developing, and maintaining the data architecture, infrastructure, and pipelines that enable to collect, store, process, and analyze large volumes of data. This role will play a crucial part in ensuring data availability, quality, and accessibility for data-driven decision-making.KEY ACCOUNTABILITIES• Data Pipeline Development: o Design, develop, and maintain data pipelines to ingest, process, and transform data from various sources into usable formats. o Implement data integration solutions that connect disparate data systems, including databases, APIs, and third-party data sources.• Data Storage and Warehousing:Create and manage data storage solutions, such as data lakes, data warehouses, and NoSQL databases.Optimize data storage for performance, scalability, and cost-efficiency.Data Quality and Governance: o Establish data quality standards and implement data validation and cleansing processes.o Collaborate with data analysts and data scientists to ensure data consistency and accuracy.ETL (Extract, Transform, Load):o Develop ETL processes to transform raw data into a structured and usable format.o Monitor and troubleshoot ETL jobs to ensure data flows smoothly.Performance Tuning:o Optimize data pipelines and queries for improved performance and efficiency.o Identify and resolve bottlenecks in data processing.• Data Documentation:o Maintain comprehensive documentation for data pipelines, schemas, and data dictionaries.o Create and update data lineage and metadata documentation.Scalability and Reliability:o Design data infrastructure to scale with growing data volumes and business requirements.o Implement data recovery and backup strategies to ensure data availability and resilience.• Collaboration:o Collaborate with cross-functional teams, including data scientists, analysts, and business stakeholders, to understand data requirements and deliver data solutions.o Provide technical support and guidance to data users.• Continuous Learning:o Stay updated on emerging technologies, tools, and best practices in data engineering.o Implement new technologies to enhance data processing capabilities.QUALIFICATIONS, EXPERIENCE, & COMPETENCIES• 9+ years of experience in similar role• Bachelor's or master’s degree in computer science, Information Technology, or a related field.• Proven experience in data engineering, ETL development, and data integration.• Proficiency in data pipeline orchestration tools (e.g., Apache NiFi, Apache Airflow).• Strong knowledge of databases (SQL and NoSQL), data warehousing, and data modeling concepts.• Familiarity with data processing frameworks (e.g., Hadoop, Spark) and cloud-based data services (e.g., AWS, Azure, GCP).• Experience with version control systems (e.g., Git) and data versioning.• Excellent programming skills in languages such as Python, SQL, Java, Scala, R, and/or Go.• Knowledge of data security and compliance standards.• Strong problem-solving and troubleshooting skills.• Effective communication and teamwork abilities.Interviews in Chennai –Positions: Python /java /data engineer/ fronted developer Interview Dates: (20th September Saturday)Years of experience - 4-12 YearsPreferences – previous experience in BFSI, NBFC, MFI or in fintech organization.Venue: will be informed shortly (Chennai)Eligibility Criteria: BE/ B. Tech only.sahiba 8296043355

  • Senior Data Scientist

    3 days ago

    Chennai, Tamil Nadu, India, Tamil Nadu Crayon Data Full time

    Role: Sr Data ScientistExperience level: 5 to 7 yearsLocation: ChennaiWhy Crayon? Why now?Crayon is transforming into an AI first company, and every Crayon (that’s what we call ourselves!) is undergoing a journey of upskilling and expanding their capabilities in the AI space.We're building an organization where AI is not a department—it’s a way of...

  • Data Engineer

    1 week ago

    Chennai, Tamil Nadu, India NTT DATA Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Req ID: 336026NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer - Azure to join our team in Chennai, Tamil Nādu (IN-TN), India (IN). "Job Duties: Key Responsibilities:...

  • Data Engineer

    2 weeks ago

    Chennai, Tamil Nadu, India CX Data Labs Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    HiRole - Azure Data EngineerLocation - Chennai, Gurugram (5days Office)Full timeShift timing 2pm to 11pmKey Responsibilities:· Develop, maintain, and optimize scalable ETL/ELT pipelines using PySpark and Databricks.· Collaborate with cross-functional teams to design and implement data models and data integration solutions.· Create and maintain robust SQL...

  • Data Engineer

    6 days ago

    Chennai, Tamil Nadu, India CX Data Labs Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    HiRole - Azure Data engineerLocation - Chennai, Gurugram (5days Onsite)Full timeImmediate joiner Only (15days Notice period only)Technical Skills:o Proficiency in SQL for complex queries, database design, and optimization.o Strong experience with PySpark for data transformation and processing.o Hands-on experience with Databricks for building and managing...

  • Data Engineer

    3 weeks ago

    Chennai, Tamil Nadu, India, Tamil Nadu LTIMindtree Full time

    Ready to trade your to-do list for a to-do the impossible list?Join a team that's building the future of IIOT.We have arranged a Walk-In Drive on 20-Sep ( Saturday)Time : 9:00 AM to 2:30 PMJob Summary Seeking a Specialist with 5 to 7 years of experience in AWS IoT Data Engineering and strong Python skills to design and implement scalable IoT data solutions4...

  • Data Engineer

    3 weeks ago

    Chennai, Tamil Nadu, India, Tamil Nadu Cleantech Industry Resources Full time

    DATA ENGINEERWho We Are?Cleantech Industry Resources accelerates United States solar, battery storage and EV projects by providing turnkey development as a service including 100% internal systems engineering. The company deploys a leading team that spun out of the largest solar power producer in the world. This team operates within a sophisticated suite of...

  • Data Engineer

    3 weeks ago

    Chennai, Tamil Nadu, India, Tamil Nadu IntraEdge Full time

    Job Title: Data EngineerExperience: 3 to 7 YearsLocation: ChennaiWork Mode: Onsite / Hybrid (as applicable)Job Description:We are looking for a highly skilled and motivated Data Engineer with 3 to 7 years of experience to join our growing team in Chennai. The ideal candidate will have strong expertise in DBT, Snowflake, CI/CD pipelines, and SQL, with a good...

  • Data Engineer

    3 weeks ago

    Chennai, Tamil Nadu, India, Tamil Nadu R Systems Full time

    At R Systems , You will contribute to the design and development of data systems including pipelines, APIs, analytics, AI and machine learning at scale. You'll be a core part of our Data team. This role emphasizes hands-on development, reliability, and team collaboration.Experience & Technical Requirements:3–5 years of development experience, with...

  • Data Engineer

    3 weeks ago

    Chennai, Tamil Nadu, India, Tamil Nadu SuperOps Full time

    About the RoleWe are looking for a Data Engineer to design, build, and maintain scalable data infrastructure that powers analytics, reporting, and AI-driven initiatives. You will work with modern columnar databases, design efficient ETL/ELT pipelines, and ensure the reliability and performance of our data ecosystem.ResponsibilitiesDesign, develop, and...

  • Data Engineer

    3 weeks ago

    Chennai, Tamil Nadu, India, Tamil Nadu KaarTech Full time

    Key Responsibilities· Data Pipeline Development: Design, develop, and maintain scalable data pipelines to support various data analytics and reporting needs.· Data Integration: Integrate data from multiple sources and ensure data quality and consistency.· Data Modelling: Build and optimize data models using Spark to support complex data transformations...