Big Data Architect

3 weeks ago

Bengaluru, India Adobe Full time
Our CompanyChanging the world through digital experiences is what Adobe’s all about. We give everyone—from emerging artists to global brands—everything they need to design and deliver exceptional digital experiences We’re passionate about empowering people to create beautiful and powerful images, videos, and apps, and transform how companies interact with customers across every screen.We’re on a mission to hire the very best and are committed to creating exceptional employee experiences where everyone is respected and has access to equal opportunity. We realize that new ideas can come from everywhere in the organization, and we know the next big idea could be yours

What

You’ll Do

Build the underneath data platform and maintain data processing pipelines using best in class technologies. Special focus on R&D to challenge status-quo and build the next generation big data platform that is efficient and cost effective.

Translate complex technical and functional requirements into detailed designs.

Collaborate with Data Scientists and Product Managers to bring AI-based Assistive experiences to life. Create the roadmap and socialize among team members and stake holders.

Create and instill a team culture that focuses on sound scientific processes and encourages deep engagement with our customers.​

Handle project scope and risks with data, analytics, and creative problem-solving.

Help define data governance policies and implement security and privacy guard rails.

What you require:

Hands-on engineer with extensive experience ingesting, storing, processing, and analyzing large datasets

Understanding of data-warehousing and data-modelling techniques

Experience working (deploying and operationalizing) with DNN frameworks like TensorFlow or Py Torch on large-scale data sets will be a great plus.

Proficient in some of the following tools and technologies:

Languages: Python, Java/Scala, SQL

Dev-ops pipelines

Container orchestration: Docker, Kubernetes

Hadoop ecosystem: Hadoop, Spark, Hive etc.

Stream processing: Storm, Flink etc.

Workflow: Airflow, Flyte, etc.

Data Engineering ecosystem: DeltaLake, DataHub etc.

General understanding of data structures, algorithms, multi-threaded programming, and distributed computing concepts

Ability to be a self-starter and work closely with other data scientists and software engineers to design, test, and build production-ready ML and optimization models and distributed algorithms running on large-scale data sets.

Ideal Candidate Profile:

A total of 10+ years of experience in technical roles involving Big Data Engineering, implementation of Machine Learning models.

Masters or

in Engineering.

Deep knowledge of Big Data Architectures, Platforms, Frameworks.

Experience with Real Time Bidding / Ad Tech background preferred.

Comfort with ambiguity, adaptability to dynamic environment, and the ability to lead a team while working autonomously.

Demonstrated ability to influence technical and non-technical stakeholders.

Track record of delivering cloud-scale, data-intensive applications and services that are widely adopted with large customer bases.

An ability to think strategically, look around corners, and create a vision for the current quarter, the year, and five years down the road.

A relentless pursuit of great customer experiences and continuous improvements to the product.

Excellent Verbal, Written and interpersonal communication skills.

  • Big Data Architect

    1 week ago

    Bengaluru, India Cognizant Full time

    Hadoop Solution Architect: Big Data Solution Architect | Hadoop Solution Architect: Big Data Solution Architect Hadoop Solution Architect: Big Data Solution Architect Job Information Required skills and experience Minimum of 15 years; experience in diverse data environments. Extensive Database and Data Analysis technology skills and experience. Requires...

  • Big Data Architect

    2 months ago

    Bengaluru, India RiskInsight Consulting Pvt Ltd Full time

    ResponsibilitiesDesign and architect Big Data solutions to meet business requirements.Collaborate with stakeholders to understand their data and analytics needs.Create and maintain data models, data flow diagrams, and data integration strategies.Develop and implement data ingestion, processing, and storage solutions using Big Data technologies.Optimize data...

  • Big data architect

    2 months ago

    Bengaluru, India Virtusa Full time

    Big data architect - CREQ185795 Description Position: Big data architect Location: BLR Primary skills: Big data hadoop spark & aws Experience in building SparkStreaming process. Proficient in understanding distributed computing principles. Experience in managing Hadoop cluster, BigData with all services.Proficiency with Hadoop MapReduce HDFS Pig Hive...

  • Big data architect

    1 week ago

    Bengaluru, India Virtusa Full time

    Big data architect - CREQ185795 Description Position: Big data architect Location: BLR Primary skills: Big data hadoop spark & aws Experience in building SparkStreaming process. Proficient in understanding distributed computing principles. Experience in managing Hadoop cluster, BigData with all services.Proficiency with Hadoop MapReduce HDFS Pig Hive...

  • Big Data Architect

    2 months ago

    Bengaluru, India RiskInsight Consulting Pvt Ltd Full time

    Responsibilities Design and architect Big Data solutions to meet business requirements. Collaborate with stakeholders to understand their data and analytics needs. Create and maintain data models, data flow diagrams, and data integration strategies. Develop and implement data ingestion, processing, and storage solutions using Big Data technologies. Optimize...

  • Big Data Architect

    1 week ago

    Bengaluru, India RiskInsight Consulting Pvt Ltd Full time

    Responsibilities Design and architect Big Data solutions to meet business requirements. Collaborate with stakeholders to understand their data and analytics needs. Create and maintain data models, data flow diagrams, and data integration strategies. Develop and implement data ingestion, processing, and storage solutions using Big Data technologies. Optimize...

  • Big Data Architect

    1 month ago

    Bengaluru, India Bizessence Full time

    **Job Description**: - Overall experience of over 8+ years in big data space in leading projects or unit of work. - Experience in architecting, designing, and delivering data pipelining solutions in cloud technologies such as Azure Synapse, AWS EMR, Databricks or Snowflake. Certifications are a plus. - Project experience in Data Warehousing, Business...

  • Big Data Architect

    2 months ago

    Bengaluru, India RARR Technologies Full time

    **Job Details - Big Data Architect**: **Job ID**: - RARR Job 2839**Job Title**: - Big Data Architect**Job Type**: - Permanent**Job Location**: - BENGALURU / BANGALORE, NAGPUR, PUNE**Total Experience**: - 10 - 15 Years**Skills**: - JAVA, SPARK**Posted - **05/01/2023 **Job Description**: - Roles and Responsibilities of role - Development of customer...

  • Big Data Architect

    11 hours ago

    Bengaluru, Karnataka, India Unison Consulting Full time

    **Responsibilities**: Design and architect Big Data solutions to meet business requirements. Collaborate with stakeholders to understand their data and analytics needs. Create and maintain data models, data flow diagrams, and data integration strategies. Develop and implement data ingestion, processing, and storage solutions using Big Data...

  • Azure Big Data Architect

    1 month ago

    Bengaluru, India Tiger Analytics Full time

    Tiger Analytics is a global analytics consulting firm. With data and technology at the core of our solutions, we are solving some of the toughest problems out there. Our culture is modeled around expertise and mutual respect with a team first mindset. - Working at Tiger, you’ll be at the heart of this AI revolution. You’ll work with teams that push the...

  • Big Data Architect

    1 month ago

    Bengaluru, India Bizessence Pty Ltd Full time

    Centelon is a modern, young technology company that carries an unflinching passion to help clients innovate, adapt and succeed. We are a business-technology products, solutions and services company. At Centelon, we harness the power of AI, digital and other emerging technologies to help our clients adapt to the evolving world. Centelon is a trusted partner...

  • Big data architect

    2 months ago

    Bengaluru, India Virtusa Full time

    Big data architect - CREQ185795 DescriptionPosition: Big data architectLocation: BLRPrimary skills: Big data hadoop spark & awsExperience in building SparkStreaming process. Proficient in understanding distributed computing principles. Experience in managing Hadoop cluster, BigData with all services.Proficiency with Hadoop MapReduce HDFS Pig Hive and Impala....

  • Big data architect

    1 week ago

    Bengaluru, India Virtusa Full time

    Big data architect - CREQ185795 DescriptionPosition: Big data architectLocation: BLRPrimary skills: Big data hadoop spark & awsExperience in building SparkStreaming process. Proficient in understanding distributed computing principles. Experience in managing Hadoop cluster, BigData with all services.Proficiency with Hadoop MapReduce HDFS Pig Hive and Impala....

  • Azure Big Data Architect

    1 week ago

    Bengaluru, India Tiger Analytics Full time

    Job DescriptionTiger Analytics is a global analytics consulting firm. With data and technology at the core of our solutions, we are solving some of the toughest problems out there. Our culture is modeled around expertise and mutual respect with a team first mindset.Working at Tiger, you’ll be at the heart of this AI revolution. You’ll work with teams...

  • Cloud Big Data Architect

    2 months ago

    Bengaluru, India Impetus Technologies Full time

    Cloud Data Architect Do you want to work with the best minds in the industry, create high-performance scalable solutions? Do you want to be part of the team that is solutioning next-gen data platforms? Then this is the place for you. You want to architect and deliver solutions involving data engineering on Petabyte scale of data, that solve complex...

  • Azure Big Data Architect

    1 week ago

    Bengaluru, India Tiger Analytics Full time

    Job Description Tiger Analytics is a global analytics consulting firm. With data and technology at the core of our solutions, we are solving some of the toughest problems out there. Our culture is modeled around expertise and mutual respect with a team first mindset. Working at Tiger, you’ll be at the heart of this AI revolution. You’ll work with...

  • Big Data Architect

    1 month ago

    Bengaluru, India Texas Instruments Full time

    **About TI** Texas Instruments Incorporated (TI) is a global semiconductor design and manufacturing company that develops analog ICs and embedded processors. By employing the world’s brightest minds, TI creates innovations that shape the future of technology. TI is helping about 100,000 customers transform the future, today. We’re committed to building...

  • Big Data Architect

    2 months ago

    Bengaluru, India I Square Soft Full time

    Big Data ArchitectJob DescriptionCandidate is responsible for guiding the full lifecycle of a Hadoop solution, including requirements analysis, platform selection, technical architecture design,Infra design and build, testing, and deploymentThis position requires building the Bigdata/Hadoop/NoSQL DB capability in Infrastructure services under Technology...

  • Big Data Architect

    1 week ago

    Bengaluru, India I Square Soft Full time

    Big Data ArchitectJob DescriptionCandidate is responsible for guiding the full lifecycle of a Hadoop solution, including requirements analysis, platform selection, technical architecture design,Infra design and build, testing, and deploymentThis position requires building the Bigdata/Hadoop/NoSQL DB capability in Infrastructure services under Technology...

  • Big Data Architect

    1 month ago

    Bengaluru, India Databricks Full time

    As a** Resident Solutions Architect** in our Professional Services team you will work with clients on short to medium term customer engagements on their big data challenges using the Databricks platform. You will provide data engineering, data science, and cloud technology projects which require integrating with client systems, training, and other technical...