Big Data Solutions Architect

3 days ago


pune, India bluCognition Full time
About bluCognition :
bluCognition is an AI/ML based start-up specializing in developing data products leveraging alternative data sources and providing servicing support to our clients globally. We are headquartered in the US, with the delivery centre in Pune.
Our clients are some of the biggest and the most progressive names in the financial & telecom industry. We are entering a significant growth phase and are looking for individuals with entrepreneurial mindset who wants us to join in this exciting journey.
: Big Data Solutions Architect
Description:
bluCognition is seeking a Big Data Solutions Architect to lead the integration, transformation, and distribution of large-scale datasets. This role involves designing robust data architectures using Snowflake or equivalent cloud data platforms and building APIs for secure data redistribution. The successful candidate will manage a technical team, ensuring the architecture scales to handle millions of customer records, while also delivering high performance and maintaining data security standards.
Responsibilities:
1. Data Architecture Design:
- Develop a scalable architecture to consume, transform, and redistribute large datasets hosted on Snowflake or other cloud data platforms.
- Optimize SQL queries and ETL/ELT pipelines for efficient data processing and transformation.
2. API Development and Integration:
- Design secure and scalable APIs for data redistribution to clients.
- Ensure APIs meet performance benchmarks and integrate seamlessly with partner applications.
3. Team Management and Leadership:
- Build and lead a data engineering team to manage large-scale data operations.
- Assign responsibilities, track project progress, and ensure smooth delivery.
4. Cloud and Big Data Technologies:
- Manage Snowflake infrastructure or equivalent cloud data platforms such as BigQuery, Redshift, Synapse, or Databricks.
- Implement ETL/ELT pipelines leveraging appropriate cloud-native tools and frameworks.
- Ensure data infrastructure scales to handle increasing data volumes efficiently.
5. Compliance and Security:
- Ensure all solutions comply with relevant data security and privacy regulations.
- Implement role-based access controls (RBAC) and monitor data access patterns.
6. Project Execution and Delivery:
- Collaborate with internal stakeholders to align data projects with business goals.
- Manage project risks, monitor progress, and ensure timely delivery.
Qualifications:
- 7+ years of experience in data engineering or big data architecture roles.
- Expertise in Snowflake or equivalent cloud platforms (e.g., BigQuery, Redshift, Synapse).
- Strong knowledge of SQL optimization, API development, and ETL/ELT processes.
- Experience managing cloud platforms such as AWS, GCP, or Azure.
- Proven ability to lead and mentor technical teams.
Preferred:
- Familiarity with financial data or credit risk modeling.
- Experience in cost optimization for cloud data platforms.
- Ability to collaborate with cross-functional teams and adapt in a dynamic environment.

  • Pune, India BluCognition Full time

    About blu Cognition : blu Cognition is an AI/ML based start-up specializing in developing data products leveraging alternative data sources and providing servicing support to our clients globally. We are headquartered in the US, with the delivery centre in Pune. Our clients are some of the biggest and the most progressive names in the financial &...


  • Pune, India BluCognition Full time

    About blu Cognition :blu Cognition is an AI/ML based start-up specializing in developing data products leveraging alternative data sources and providing servicing support to our clients globally. We are headquartered in the US, with the delivery centre in Pune.Our clients are some of the biggest and the most progressive names in the financial & telecom...


  • Pune, India bluCognition Full time

    About bluCognition : bluCognition is an AI/ML based start-up specializing in developing data products leveraging alternative data sources and providing servicing support to our clients globally. We are headquartered in the US, with the delivery centre in Pune. Our clients are some of the biggest and the most progressive names in the financial & telecom...


  • Pune, India bluCognition Full time

    About bluCognition :bluCognition is an AI/ML based start-up specializing in developing data products leveraging alternative data sources and providing servicing support to our clients globally. We are headquartered in the US, with the delivery centre in Pune.Our clients are some of the biggest and the most progressive names in the financial & telecom...


  • pune, India bluCognition Full time

    About bluCognition :bluCognition is an AI/ML based start-up specializing in developing data products leveraging alternative data sources and providing servicing support to our clients globally. We are headquartered in the US, with the delivery centre in Pune.Our clients are some of the biggest and the most progressive names in the financial & telecom...


  • Pune, India bluCognition Full time

    About bluCognition :bluCognition is an AI/ML based start-up specializing in developing data products leveraging alternative data sources and providing servicing support to our clients globally. We are headquartered in the US, with the delivery centre in Pune.Our clients are some of the biggest and the most progressive names in the financial & telecom...


  • Bangalore/Pune/Mumbai/Chennai, India a client of change leaders Full time

    Job Title: Big Data EngineerJob Summary: We are seeking a highly skilled Big Data Engineer to join our team. The successful candidate will be responsible for designing and implementing scalable Big Data applications and solutions on distributed platforms.Key Responsibilities:Design and implement data pipelines using Snowflake, PostgreSQL, and...


  • Pune, India bluCognition Full time

    About bluCognition : bluCognition is an AI/ML based start-up specializing in developing data products leveraging alternative data sources and providing servicing support to our clients globally. We are headquartered in the US, with the delivery centre in Pune. Our clients are some of the biggest and the most progressive names in the financial & telecom...


  • pune, India bluCognition Full time

    About bluCognition : bluCognition is an AI/ML based start-up specializing in developing data products leveraging alternative data sources and providing servicing support to our clients globally. We are headquartered in the US, with the delivery centre in Pune. Our clients are some of the biggest and the most progressive names in the financial & telecom...


  • Pune, India Mig Staffing Full time

    Job Title: Big Data EngineerWe are seeking a highly skilled Big Data Engineer to join our team at Mig Staffing. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining our company's Big Data solutions.Key Responsibilities:Design and implement Big Data tools and frameworks to meet the company's data...

  • Big Data Architect

    2 weeks ago


    Bangalore/Pune/Mumbai/Chennai, India a client of change leaders Full time

    Job SummaryWe are seeking a highly skilled Big Data Architect to join our team at a client of change leaders. As a key member of our data engineering team, you will be responsible for designing and implementing scalable Big Data applications and solutions on distributed platforms.Key ResponsibilitiesDesign and implement data pipelines using Snowflake,...

  • Big Data Architect

    5 months ago


    Pune, India Ellicium Full time

    What are we about? At Ellicium be ready for contagious excitement, worthy challenges and enriching learning experience every day. We trust in the process of failing fast and learning fast. You will find ‘Ellicians’ putting their heart to get the perfect dish during our monthly potlucks or arguing over best Nolan movie during lunch breaks. It is all about...

  • Data Engineer

    3 months ago


    Pune, India Rao Career Solutions Full time

    Job Summary :- We are looking for a skilled Data Engineer with hands-on experience in PySpark and Big Data platforms to join our growing team. The ideal candidate will have strong expertise in building data pipelines, working with big data technologies like Apache Hive and Parquet, and handling diverse data use cases. You will work closely with data...


  • Pune, India Mig Staffing Full time

    Job Title: Big Data EngineerWe are seeking a highly skilled Big Data Engineer to join our team at Mig Staffing. As a key member of our data engineering team, you will be responsible for designing, developing, and implementing large-scale data processing systems using Hadoop technologies.Key Responsibilities:Design and develop Hadoop systems to process and...


  • Pune, Maharashtra, India Data Axle Full time

    About Data Axle:Data Axle Inc., a 50-year industry leader in data, marketing solutions, sales, and research, has set up a strategic global centre of excellence in Pune.Job Description:We are seeking a Senior Data Engineer to design, implement, and support an analytical data infrastructure providing ad-hoc access to large datasets and computing power.Key...


  • Pune, India Ellicium Full time

    What are we about? At Ellicium be ready for contagious excitement, worthy challenges and enriching learning experience every day. We trust in the process of failing fast and learning fast. You will find ‘Ellicians’ putting their heart to get the perfect dish during our monthly potlucks or arguing over best Nolan movie during lunch breaks. It is all about...

  • Data Engineer

    2 weeks ago


    Bangalore/Pune/Trivandrum/Thiruvananthapuram, India Rao Career Solutions Full time

    Job Summary :Data engineers play a vital role in building and maintaining scalable data pipelines. We are seeking a skilled Data Engineer with expertise in PySpark and Big Data platforms to join our team at Rao Career Solutions. The ideal candidate will have strong expertise in building data pipelines, working with big data technologies like Apache Hive and...


  • Hyderabad/Pune/Delhi NCR, India Ace Recruit Full time

    Job Title: Big Data EngineerJob Summary:We are seeking a highly skilled Big Data Engineer to join our team at Ace Recruit. As a Big Data Engineer, you will be responsible for designing and building scalable data ingestion pipelines, conceptualizing and executing high-performance data processing, and collaborating with multiple teams to meet deadlines.Key...


  • Hyderabad/Pune/Delhi NCR, India Ace Recruit Full time

    Job SummaryWe are seeking an experienced Big Data Engineer to join our team at Ace Recruit. As a Big Data Engineer, you will be responsible for designing and building scalable data ingestion pipelines, processing high-performance data, and collaborating with multiple teams to bring analytical solutions to life.Key ResponsibilitiesDesign and build scalable...

  • Gdc Big Data Architect

    5 months ago


    Pune, India Cranium IT Inc Full time

    skill: Exp: 10+ years Joining: immediate to max 30 days JD: design of SDP data platform, - 8+ years of experience - Hands-on experience in Big Data (Cloudera - Hadoop, Spark, etc.) - Hands-on experience in stream processing (RT/NRT) - Apache Kafka, NiFi and similar - Strong background in developing and utilizing tools that prepare, extract and manipulate...