Current jobs related to Principal Architect - Kottayam - Closeloop Technologies

Job Title: Director- Data Engineer

Experience: 15+ years

This role requires the flexibility to travel to our Chandigarh office as needed and strong communication skills to effectively engage with stakeholders and team members.

Job Overview:

We are seeking an Director of Data Engineering with over 15 years of industry experience. This role involves a combination of hands-on technical expertise and team leadership. The ideal candidate will not only design, build, and maintain large-scale data processing systems but also lead and mentor a team of engineers, ensuring the reliability and scalability of our data infrastructure. You will work closely with cross-functional teams, driving collaboration and ensuring data quality, performance, and security across the organization.

Key Responsibilities:

-Data Architecture & Strategy: Lead the design and implementation of scalable data architectures to support current and future business needs. Develop long-term data strategies aligned with organizational goals.

-Team Leadership: Manage, mentor, and grow a high-performing team of data engineers. Provide technical guidance, establish best practices, and foster a culture of collaboration and innovation.

-Data Integration & Pipeline Development: Oversee the development and maintenance of robust ETL pipelines, ensuring smooth data flow across internal and external systems. Ensure that data integration efforts are aligned with the company's objectives.

-Big Data Solutions: Lead efforts in working with large datasets using big data tools like Hadoop, Spark, and cloud-based platforms (AWS, GCP, Azure), ensuring scalable and efficient data processing.

-Data Warehousing: Architect and optimize data warehouses and data lakes for efficient handling of large data volumes. Work with the team to ensure data accessibility for analytics and reporting purposes.

-Automation & Optimization: Identify and implement automation opportunities in data collection, processing, and analysis. Continuously optimize data storage, retrieval, and query performance.

-Cross-functional Collaboration: Work closely with data scientists, analysts, and product teams to ensure that data engineering efforts align with business requirements and analytical needs. Lead collaboration with other teams for seamless project execution.

-Security & Compliance: Ensure the data infrastructure adheres to security protocols and complies with relevant data governance policies. Maintain the highest standards for data privacy and security.

-Performance Management & Reporting: Regularly review team performance and provide coaching for continuous improvement. Set clear objectives and KPIs for the team, tracking progress and outcomes.

Required Qualifications:

-15+ years of experience in Data Engineering, with at least 5 years in a leadership role.

-Proficiency in SQL and NoSQL databases (e.g., MySQL, PostgreSQL, MongoDB).

-Experience in designing and managing data pipelines using tools such as Apache Airflow, Kafka, or NiFi.

-Expertise in programming languages like Python, Java, or Scala.

-Extensive knowledge of distributed systems and cloud technologies (AWS, GCP, Azure).

-Strong experience with ETL frameworks, data modeling, and data warehousing solutions.

-Proven ability to manage and scale large teams of data engineers.

-Strong analytical and problem-solving skills, with the ability to guide teams through technical challenges.

-Excellent communication and leadership skills, with a proven track record of cross-functional collaboration.