Senior BigData/Spark Solution Architect

2 weeks ago

Bengaluru, India Tredence Inc. Full time
Job Description

Role requires experience in delivering end-to-end data driven applications leveraging modern tools and technologies with focus on architecture, solutioning, and design aspects in the end-to-end data management.

Mandatory Skills:

Cloud (AWS / Azure / GCP), Databricks, Spark, PySpark, SQL & Data Warehouse

What we look for:

- Total 12+ years of experience in delivering data driven applications using Big Data technologies such as Spark, Kafka, Cloud, Data Lakes, Data Warehouse in a customer-facing, technical architecture, or consulting role.- Minimum of 6+ years of experience working on Big Data Architectures independently.- Minimum 5+ years of experience working with any database/data warehouse platforms such as Oracle, Teradata, Snowflake, Red Shift etc.- Strong experience working in the Databricks ecosystem.- Comfortable writing code in either Python or Scala.- Experience working across Cloud Platforms (GCP / AWS / Azure)- Documentation and white-boarding skills.- Experience working with clients and managing conflicts.- Build skills in technical areas which support the deployment and integration of Databricks-based solutions to complete customer projects.- Experience building data engineering solutions covering ingestion, integration and provisioning using either tools or open standards.- Experience conducting rapid prototypes or proof of concept for picking right tool or service for a specific functional / non-functional requirement.- Experience with developing data platforms architecture in one or more of the Cloud platforms – Azure, GCP and AWS- Experience gathering technology requirements from different stakeholders and translating to optimal design.- Experience building solutions / frameworks / accelerators or automation experience in data management projects.- Familiarity with different services and respective performance and cost implications in one or more Cloud platforms- Experience with Optimizing different data & ML pipelines for performance, cost and reusability.- Worked with modern ETL and Data Movement tools for different patterns – real-time, near real-time and batch.- Strong knowledge of continuous integration, static code analysis and test-driven development- Experience in delivering projects in a highly collaborative delivery model with teams onsite and offshore.- Ability to iteratively design and develop solutions from a concept / idea.- Able to work in a rapidly changing business environment and adapt to the fast-paced environment quickly.- Strong verbal and written communications skills are a must, as well as the ability to work effectively across internal and external organizations.

Impact you will have (Roles & Responsibilities):

- You will work on a variety of impactful customer technical projects which may include building reference architectures, how to do and production grade MVP’s.- Guide strategic customers as they implement transformational big data projects, 3rd party migrations, including end-to-end design, build and deployment of industry-leading big data and AI applications.- Consult on architecture and design; bootstrap or implement strategic customer projects which leads to a customers' successful understanding, evaluation, and adoption of Databricks & Data Engineering.- Ideate, design, develop and deliver data engineering solutions and accelerators with the clear objective of helping our clients generate more value from less.- Architect data management platform one or more Cloud platform based on functional and non-functional requirements.- Review the architecture, solution and design against set parameters and provide recommendations.- Work with internal stakeholders and client teams in defining robust technology standards, guidelines, and best practices.- Estimate cost of the platform and cost of ownership with some reasonable assumptions- Optimize the data pipelines for performance and cost.- Rationalize design decisions with objective proof points.- Work with different stakeholders such as IT leadership on solution design and architecture

About Tredence:

Tredence is a global data science solutions provider founded in 2013 by Shub Bhowmick, Sumit Mehra, and Shashank Dubey focused on solving the last-mile problem in AI. Headquartered in San Jose, California, the company embraces a vertical-first approach and an outcome-driven mindset to help clients win and accelerate value realization from their analytics investments. The aim is to bridge the gap between insight delivery and value realization by providing customers with a differentiated approach to data and analytics through tailor-made solutions. Tredence is 2,200+ employees strong with offices in San Jose, Foster City, Chicago, London, Toronto, and India (Bangalore, Pune, Chennai, Gurugram & Kolkata), with the largest companies in retail, CPG, hi-tech, telecom, healthcare, travel, and industrials as clients.

As we complete 11 years of Tredence this year, we are on the cusp of an ambitious and exciting phase of expansion and growth.

Tredence recently closed a USD 175 million Series B funding, which will help us build on growth momentum, strengthen vertical capabilities, and reach a broader customer base.

Apart from our geographic footprint in the US, Canada & UK, we plan to open offices in Kolkata. In 2023, we also plan to hire more than 1000 employees across markets.

Tredence is a Great Place to Work (GPTW) certified company that values its employees and creates a positive work culture by providing opportunities for professional development and promoting work-life balance.

At Tredence, nothing is impossible; we believe in pushing ourselves to limitless possibilities and staying true to our tagline, Beyond Possible.

  • Associate Solution Architect/ Solution Architect

    4 weeks ago

    Bengaluru, India Impetus Full time

    We are looking to Hire Passionate professionals for Solution Architect roles with Good hands-on experience in Bigdata (Spark, and Hadoop echo system components) and Cloud (AWS/Azure/GCP).Someone who has experience in handling Cloud Migration/Modernization projects with experience in Pre-Sales Activities (preparing Proposal/SOW, RFI, RFP).Job Description10-15...

  • Associate Solution Architect/ Solution Architect

    2 weeks ago

    Bengaluru, India Impetus Full time

    We are looking to Hire Passionate professionals for Solution Architect roles with Good hands-on experience in Bigdata (Spark, and Hadoop echo system components) and Cloud (AWS/Azure/GCP).Someone who has experience in handling Cloud Migration/Modernization projects with experience in Pre-Sales Activities (preparing Proposal/SOW, RFI, RFP).Job Description-...

  • Associate Solution Architect/ Solution Architect

    4 weeks ago

    Bengaluru, India Impetus Full time

    We are looking to Hire Passionate professionals for Solution Architect roles with Good hands-on experience in Bigdata (Spark, and Hadoop echo system components) and Cloud (AWS/Azure/GCP).Someone who has experience in handling Cloud Migration/Modernization projects with experience in Pre-Sales Activities (preparing Proposal/SOW, RFI, RFP).Job Description10-15...

  • Big Data Solutions Architect

    4 weeks ago

    Bengaluru, India Nutanix Full time

    **_Hungry, Humble, Honest, with a Heart. _** **The Opportunity**: Nutanix Solutions team oversees creating Nutanix Validated Designs, Reference Architectures, Technical Notes, and Best Practices Guides in multiple verticals like Hybrid Cloud, Networking, EUC, Database, SAP, Security, and networking. We are looking for an experienced BigData Specialist, who...

  • GCP + Bigdata

    1 month ago

    Bengaluru, India LTIMindtree Full time

    Primary Skills: Hands on experience is mandatory for the GCP, Python/Java, Spark, SQL and Bigdata.Expereince- 5 to 12 yearsLocation- Gurgaon & Bangalore• Must Have Qualifications:o Masters in computer applications or equivalent OR Bachelor degree in engineering or computer science or equivalent.o Deep understanding of Hadoop and Spark Architecture and its...

  • GCP + Bigdata

    1 month ago

    Bengaluru, India LTIMindtree Full time

    Primary Skills: Hands on experience is mandatory for the GCP, Python/Java, Spark, SQL and Bigdata. Expereince- 5 to 12 years Location- Gurgaon & Bangalore • Must Have Qualifications: o Masters in computer applications or equivalent OR Bachelor degree in engineering or computer science or equivalent. o Deep understanding of Hadoop and Spark Architecture and...

  • Senior BigData/Spark Solution Architect

    1 month ago

    Bengaluru, India Tredence Inc. Full time

    Job DescriptionRole requires experience in delivering end-to-end data driven applications leveraging modern tools and technologies with focus on architecture, solutioning, and design aspects in the end-to-end data management.Mandatory Skills:Cloud (AWS / Azure / GCP), Databricks, Spark, PySpark, SQL & Data Warehouse What we look for:Total 12+ years of...

  • Senior BigData/Spark Solution Architect

    1 month ago

    Bengaluru, India Tredence Inc. Full time

    Job DescriptionRole requires experience in delivering end-to-end data driven applications leveraging modern tools and technologies with focus on architecture, solutioning, and design aspects in the end-to-end data management.Mandatory Skills:Cloud (AWS / Azure / GCP), Databricks, Spark, PySpark, SQL & Data Warehouse What we look for:Total 12+ years of...

  • Senior BigData/Spark Solution Architect

    1 month ago

    Bengaluru, India Tredence Inc. Full time

    Job Description Role requires experience in delivering end-to-end data driven applications leveraging modern tools and technologies with focus on architecture, solutioning, and design aspects in the end-to-end data management. Mandatory Skills: Cloud (AWS / Azure / GCP), Databricks, Spark, PySpark, SQL & Data Warehouse What we look for: Total 12+ years...

  • Bigdata

    1 month ago

    Bengaluru, India CGI Full time

    Data Engineer with 5 to 7 years hands on experience for client Bell **Required Primary Skills**: Apache Spark, BigData Hadoop, Kafka, Sqoop, Cloudera manager, Python, Scala Secondary Skill HIVE, YARN Insights you can act on While technology is at the heart of our clients’ digital transformation, we understand that people are at the heart of business...

  • Bigdata JavaSpark Developer

    1 month ago

    Bengaluru, India LTIMindtree Full time

    Skill: Bigdata+ JavaSpark DeveloperLocation- All locations (Pune, Mumbai, Chennai, Bangalore, Hyderabad, Coimbatore, Kolkata, Noida)Notice Period – 0 to 45 DaysExp-4 to 13 Years• Strong experience in ETL development withJava & Spark• Strong experience with Redshift, AWS S3, SQL• Experience in developing microservices• Proficiency with Lambda...

  • Senior BigData/Spark Solution Architect

    1 month ago

    Bengaluru, India Tredence Inc. Full time

    Job DescriptionRole requires experience in delivering end-to-end data driven applications leveraging modern tools and technologies with focus on architecture, solutioning, and design aspects in the end-to-end data management.Mandatory Skills:Cloud (AWS / Azure / GCP), Databricks, Spark, PySpark, SQL & Data WarehouseWhat we look for:Total 12+ years of...

  • BigData Engineer

    4 weeks ago

    Bengaluru, India Fractal Full time

    It's fun to work in a company where people truly BELIEVE in what they are doing!The BigData Engineers have expertise in building horizontally scalable applications using distributed technologies like NoSQL Dbs/Hadoop/Spark and others and we execute projects on-premise and cloud based systems. The AI-Engineers and MLOps Engineers work on scaling AI-systems...

  • Bigdata ETL-Testing

    2 weeks ago

    Bengaluru, India RiskInsight Consulting Pvt Ltd. Full time

    Hands on with In-depth knowledge in BigData ETL Testing Experience in Hadoop Hive is a must ETL test automation experience Cloudera experience is good to have Python/spark experience is added advantage Plan and execute activities in relation to test preparation, automation, execution, and reporting Develop Test specifications based on various requirement...

  • MakeMyTrip - Senior Data Engineer I/II - Spark/Scala

    2 weeks ago

    Bengaluru, India MakeMyTrip Full time

    Position : Senior Data Engineer I / Senior Data Engineer II. Experience : Must have 2+ years of experience. About Role : We are looking for experienced Data engineers with excellent problem-solving skills to develop machine-learning powered Data Products design to enhance customer experiences.About us : Nurtured from the seed of a single great idea to...

  • Bigdata + Python + Aws

    7 days ago

    Bengaluru, India Black & White Business Solutions Full time

    **Job Information**: Industry **IT Services** *** Province **Karnataka** *** City **Bangalore North** *** Postal Code **560001** *** Country **India** Python + Bigdata Developer. 7+ years of development experience in the core tools and technologies like SQL, Python, AWS (Lambda, Glue, S3, Redshift, Athena, IAM Roles & Policies), PySpark used by...

  • Big Data Architect

    4 weeks ago

    Bengaluru, India I Square Soft Full time

    Big Data ArchitectJob DescriptionCandidate is responsible for guiding the full lifecycle of a Hadoop solution, including requirements analysis, platform selection, technical architecture design,Infra design and build, testing, and deploymentThis position requires building the Bigdata/Hadoop/NoSQL DB capability in Infrastructure services under Technology...

  • Senior Software Engineer

    4 weeks ago

    Bengaluru, India The Nielsen Company Full time

    At Nielsen, we believe that career growth is a partnership. You ultimately own, fuel and set the journey. By joining our team of nearly 14,000 associates, you will become part of a community that will help you to succeed. We champion you because when you succeed, we do too. Embark on a new initiative, explore a fresh approach, and take license to think big,...

  • Big Data Architect

    1 month ago

    Bengaluru, India I Square Soft Full time

    Big Data Architect Job Description Candidate is responsible for guiding the full lifecycle of a Hadoop solution, including requirements analysis, platform selection, technical architecture design, Infra design and build, testing, and deployment This position requires building the Bigdata/Hadoop/NoSQL DB capability in Infrastructure services under...

  • Solution Architect

    4 weeks ago

    Bengaluru, India Shell Full time

    **The Role**: **The Senior Solution Architect - SSW & NBD owns the architecture delivery of Solution architecture for business (in this context SSW & NBD business domain) projects, programs and products. Senior Solution Architects (SA) are responsible for delivering solution guidance and designs to projects and running operations. Key objectives are: fit for...