Frost & Sullivan - Data Architect - Spark/Apache Airflow

4 weeks ago

Tamil Nadu, India Frost and Sullivan (India) Private Limited Full time

About the job :

At Frost & Sullivan, we are seeking a highly skilled and experienced Data Architect to join our Digital Products team The ideal fit for the role will be a person experienced in designing, building, and maintaining an organization's data architecture.

The key focus of the position is designing and implementing data models, data integration solutions, and data management systems that ensure data accuracy, consistency, and security.

Developing and maintaining data dictionaries, metadata, and data lineage documents to ensure data governance and compliance is a key responsibility of the data architect.

Beyond technical capabilities, the data engineer will need strong problem-solving skills and the ability to think critically are also essential to identify and implement solutions to complex data issues.

We're looking for someone willing to jump right in and help the company get the most from its data.

Duties & Responsibilities :

- Design and implement efficient data architectures, storage solutions, and data processing workflows, with a focus on stream processing, event queuing capabilities, and advanced CI/CD pipelines.

- Lead architecture design, development, and deployment of complex data-intensive systems using Kubernetes, data orchestration tools, distributed data processing frameworks, event queuing systems, and other modern technologies.

- Developing and maintaining accurate data models, data dictionaries, and data flow diagrams

- Collaborating with stakeholders to understand data requirements and translating them into technical specifications

- Performing data profiling and analysis to identify data quality issues and propose data cleansing and data integration solutions

- Implement and maintain robust security measures to protect sensitive data and ensure compliance with security standards and regulations

- Ensure the scalability, performance, and security of data-intensive systems, with a particular focus on stream processing, event queuing capabilities, and advanced CI/CD pipelines.

- Provide technical expertise and leadership to the project team, ensuring successful delivery of high-quality solutions on time and within budget.

- Stay current with emerging trends and technologies in data-intensive systems and provide thought leadership on best practices and solutions.

- Collaborate with sales and marketing teams to develop proposals and pitches that demonstrate our expertise in data-intensive systems, Kubernetes, data orchestration tools, distributed data processing frameworks, stream processing capabilities, event queuing systems, and advanced CI/CD :

- Develop and maintain a strategic data architecture that aligns with organizational goals and supports business processes.

- Create and manage data models to ensure the accurate representation of data structures, relationships, and business requirements.

- Establish and enforce data governance policies to maintain data quality, integrity, and security, ensuring compliance with regulations and standards.

- Oversee the design, implementation, and optimization of database systems for efficient data storage, retrieval, and management.

- Facilitate seamless integration of data across systems and platforms to enable effective information flow and support decision-making processes.

- Proactively identify opportunities for improving data management processes, tools, and technologies to enhance overall efficiency and effectiveness

Required Skills and Qualifications :

- 10+ years of experience in designing, implementing, and managing data-intensive systems.

- Expertise in data-intensive systems, including data architectures, storage solutions, and data processing workflows.

- Experience with Kubernetes and other container orchestration technologies.

- Experience with at least one data orchestration tool, such as Apache Airflow, Apache NiFi, Kedro, Stepfunction or Similar Technologies.

- Experience with at least one distributed data processing framework, such as Apache Spark, Apache Flink, Apache Beam or Similar Technologies.

- Very strong experience in stream processing, including real-time data processing, data ingestion, and data transformations.

- Experience with an event queuing system, such as Apache Kafka, AWS Kinesis, or Azure Event Hubs.

- Strong experience with cloud platforms such as AWS, Azure, or GCP.

- Advanced experience with CI/CD pipelines and tools such as Jenkins, GitLab, or CircleCI, including infrastructure as code, automated testing, and continuous monitoring.

- Excellent analytical and problem-solving skills.

- Strong leadership and communication skills with the ability to collaborate with cross-functional teams.

- Ability to work in a fast-paced, dynamic environment and manage multiple projects Skills And Qualifications :

- Bachelor's degree (or equivalent) in computer science, information technology, engineering, or related discipline

- Experience in building or maintaining ETL processes

Professional certification :

- Are Well-organized and detail-oriented

- Take ownership to work independently with remote supervision

- Can multi-task and meet tight deadlines

- Are disciplined and adhere to high-quality standards

- Is a strategic thinker; understands how operational activities are vital in supporting the overall strategy of the business

What will make you succeed at Frost & Sullivan?

You need to be :

- Wildly curious and entrepreneurial

- Committed to customer success

- A self-starter invested in your future

- A persuasive communicator

- Deeply Analytical

- Excited about Disruptive Trends

Benefits :

- A friendly work environment with an 'open door' policy

- A strong career path with growth opportunities.

- Be part of a global team that strives for excellence, and fosters an Olympic spirit

- Feed your intellectual curiosity by collaborating across all levels of the company across the globe

- Global Recognition - President's Club & Chairman's Club Awards

- Continuous learning and coaching

- Flexible work policy

(ref:hirist.tech)

  • Data Architect

    4 weeks ago

    Tamil Nadu, India Frost and Sullivan Private Limited Full time

    About the JobAt Frost & Sullivan, we are seeking a highly skilled and experienced Data Architect to join our Digital Products team. The ideal candidate will be responsible for designing, building, and maintaining our organization's data architecture.Key ResponsibilitiesDesign and implement efficient data architectures, storage solutions, and data processing...

  • Frost & Sullivan - Data Architect - Spark/Apache Airflow

    2 months ago

    Tamil Nadu, India Frost and Sullivan Private Limited Full time

    About the job :At Frost & Sullivan, we are seeking a highly skilled and experienced Data Architect to join our Digital Products team! The ideal fit for the role will be a person experienced in designing, building, and maintaining an organization's data architecture. The key focus of the position is designing and implementing data models, data integration...

  • Frost Growth Expert

    6 months ago

    Tamil Nadu, India Frost & Sullivan Full time

    Overview: As the Growth Pipeline Company, Frost & Sullivan continues to innovate with solutions to help Companies identify, plan, and capture Growth Opportunities around the world. Its objectives are to build a uniquely powerful Global Network of Experts - Independent Experts and Frost & Sullivan Professionals - who will Collaborate and Partner, to the...

  • Data Architect

    2 weeks ago

    tamil nadu, India Frost & Sullivan Full time

    At Frost & Sullivan, we are seeking a highly skilled and experienced Data Architect to join our Digital Products team! The ideal fit for the role will be a person experienced in designing, building, and maintaining an organization's data architecture. The key focus of the position is designing and implementing data models, data integration solutions, and...

  • Data Architect

    3 weeks ago

    tamil nadu, India Frost & Sullivan Full time

    At Frost & Sullivan, we are seeking a highly skilled and experienced Data Architect to join our Digital Products team! The ideal fit for the role will be a person experienced in designing, building, and maintaining an organization's data architecture. The key focus of the position is designing and implementing data models, data integration solutions, and...

  • Data Architect

    2 weeks ago

    tamil nadu, India Frost & Sullivan Full time

    At Frost & Sullivan, we are seeking a highly skilled and experienced Data Architect to join our Digital Products team! The ideal fit for the role will be a person experienced in designing, building, and maintaining an organization's data architecture. The key focus of the position is designing and implementing data models, data integration solutions, and...

  • Frost & Sullivan | Senior Research Associate- Mobility | tamil nadu

    1 day ago

    tamil nadu, India Frost & Sullivan Full time

    About the Role At Frost & Sullivan, we seek people who will do more than just analysis. You will play a significant role understanding and defining issues occurring in the global autonomous vehicles landscape and work with clients on their issues, challenges, and aspirations. We believe that your ability to deliver solutions to clients' problems will depend...

  • Programmer Analyst

    2 weeks ago

    tamil nadu, India Frost & Sullivan Full time

    At Frost & Sullivan, we are looking for a Programmer Analyst to produce scalable software solutions. The Programmer Analyst should have experience in front-end and should have back-end coding knowledge, development frameworks and third-party libraries and should be a collaborator with a knack for visual design and utility. The future roadmap for Frost &...

  • Programmer Analyst

    2 months ago

    tamil nadu, India Frost & Sullivan Full time

    At Frost & Sullivan, we are looking for a Programmer Analyst to produce scalable software solutions. The Programmer Analyst should have experience in front-end and should have back-end coding knowledge, development frameworks and third-party libraries and should be a collaborator with a knack for visual design and utility. The future roadmap for Frost &...

  • Executive- News Letters

    6 months ago

    Tamil Nadu, India Frost & Sullivan Full time

    About the Team: About the team The Frost & Sullivan Customer Experience Team is an integral part of the customers' journey, driving growth, and unleashing unprecedented opportunities at every step. We leverage new-age ideas to promote deliverables like growth opportunity analytics, events, and much more in a manner that is both compelling and effective. We...

  • Programmer Analyst

    3 weeks ago

    tamil nadu, India Frost & Sullivan Full time

    At Frost & Sullivan, we are looking for a Programmer Analyst to produce scalable software solutions. The Programmer Analyst should have experience in front-end and should have back-end coding knowledge, development frameworks and third-party libraries and should be a collaborator with a knack for visual design and utility. The future roadmap for Frost &...

  • Programmer Analyst

    3 months ago

    tamil nadu, India Frost & Sullivan Full time

    At Frost & Sullivan, we are looking for a Programmer Analyst to produce scalable software solutions. The Programmer Analyst should have experience in front-end and should have back-end coding knowledge, development frameworks and third-party libraries and should be a collaborator with a knack for visual design and utility. The future roadmap for Frost &...

  • Data Architect

    1 month ago

    Tamil Nadu, India Frost and Sullivan Private Limited Full time

    h2AbouttheJob/h2pWeareseekingahighlyskilledandexperiencedDataArchitecttojoinourDigitalProductsteamatFrost&Sullivan.Theidealcandidatewillhaveastrongbackgroundindesigning,building,andmaintainingdataarchitectures./ph2KeyResponsibilities/h2ulliDesignandimplementefficientdataarchitectures,storagesolutions,anddataprocessingworkflows,withafocusonstreamprocessing,ev...

  • Program Analyst- Marketing

    1 week ago

    tamil nadu, India Frost & Sullivan Full time

    About Frost & Sullivan:Frost & Sullivan, the Growth Partnership Company, works in collaboration with clients to leveragevisionary innovation that addresses the global challenges and related growth opportunities that will make or break today's market participants. Our “Growth Partnership” supports clients by addressing these opportunities and...

  • Associate

    6 months ago

    Tamil Nadu, India Frost & Sullivan Full time

    This is an entry level position. Similar traits as a Consulting Associate, usually a probationary period to be confirmed to the next level. Frost & Sullivan Growth Analytics/KaaS team seeks smart individuals to fit industry consulting and research roles. The position involves in-depth understanding of various industries which the individual would leverage to...

  • Artificial Intelligence Engineer

    2 weeks ago

    tamil nadu, India Frost & Sullivan Full time

    An associate-level position involves a range of administrative duties with a focus on supporting various aspects of organizational development and change management. The associate actively participates in implementing changes and facilitating organizational growth.We’re looking for candidates who -- 2 or more years of experience in applying AI to practical...

  • Artificial Intelligence Engineer

    2 weeks ago

    tamil nadu, India Frost & Sullivan Full time

    An associate-level position involves a range of administrative duties with a focus on supporting various aspects of organizational development and change management. The associate actively participates in implementing changes and facilitating organizational growth. We’re looking for candidates who - - 2 or more years of experience in applying AI to...

  • Artificial Intelligence Engineer

    3 weeks ago

    tamil nadu, India Frost & Sullivan Full time

    An associate-level position involves a range of administrative duties with a focus on supporting various aspects of organizational development and change management. The associate actively participates in implementing changes and facilitating organizational growth.We’re looking for candidates who -2 or more years of experience in applying AI to practical...

  • Artificial Intelligence Engineer

    2 months ago

    tamil nadu, India Frost & Sullivan Full time

    An associate-level position involves a range of administrative duties with a focus on supporting various aspects of organizational development and change management. The associate actively participates in implementing changes and facilitating organizational growth. We’re looking for candidates who - 2 or more years of experience in applying AI to...

  • Artificial Intelligence Engineer

    3 months ago

    tamil nadu, India Frost & Sullivan Full time

    An associate-level position involves a range of administrative duties with a focus on supporting various aspects of organizational development and change management. The associate actively participates in implementing changes and facilitating organizational growth.We’re looking for candidates who -2 or more years of experience in applying AI to practical...