Big Data Engineer
2 months ago
Description
Data Engineer: Primary : ADF, SQLSeconday : Databricks, Pyspark / Scala, CICD, Data Security, encryption
Responsibilities: •Work closely with scrum master, technical leads and provide daily progress updates on the tasks assigned. •Provide support in defining the scope and sizing of the work. •Working closely with various enterprise architects, Information security teams, Data management team, to ensure the architected solution meets all the needs of a customer, from a functionality perspective and IT solution engineering perspective. •Translate business requirements into technology solutions. •Lead designing of all aspects of our data solution including artifact creation such as diagrams, playbooks, and other technical documents Skills: •Over all 5 to 8 years of experience with Data Management & Big Data and Analytics. •At least 2 to 3 years of experience in implementing the data solutions on MS Azure using Azure Data Factory. •Must have strong SQL background and ability to tune the SQL for optimized ETL jobs. •one to two years of experience in Azure Synapse Analytics is plus. •Extensive hands-on experience in data warehousing design, tuning and ETL/ELT process development by using cloud native technologies. •Apache Spark experience using Scala or PySpark or pre-packaged tools like Databrick is plus. •At least one year of experience with API based/real time integrations using Kafka or similar technologies. •At least 1 to 2 years of experience with big data using spark and java for data processing. •Developing the CICD pipeline for Azure Infrastructure, version control strategy and Integrate source control (git, GitHub, azure repos). •At least one year experience with unified data governance solution using MS Purview. •In-depth understanding of various storage services offered by Azure. •Experience with implementation of data security, encryption, PII/PSI legislation, identity and access management across sources and environments. •Experience with data process Orchestration, end-to-end design and build process of Near-Real Time and Batch Data Pipelines. •Certification in Azure fundamentals (AZ-900) and Azure data engineering (DP-203) is must. •Strong client-facing communication and facilitation skills.-
Big Data Engineer
2 weeks ago
Bengaluru, India Virtusa Full timeBig Data Engineer - CREQ188642 DescriptionLooking for a Senior Software Engineer with strong analytical skills to help build and enhance our Big data application. This individual's day-to-day work will involve using Java, Scala, SQL, Big Data, Linux, git, and maven/gradle to design and build software solutions that are fast, scalable, and flexible.Bachelor's...
-
Big Data Engineer
2 weeks ago
Bengaluru, India Virtusa Full timeBig Data Engineer - CREQ188642 Description Looking for a Senior Software Engineer with strong analytical skills to help build and enhance our Big data application. This individual's day-to-day work will involve using Java, Scala, SQL, Big Data, Linux, git, and maven/gradle to design and build software solutions that are fast, scalable, and flexible....
-
Big Data Engineer
1 month ago
Bengaluru, India Adobe Full timeOur CompanyChanging the world through digital experiences is what Adobe’s all about. We give everyone—from emerging artists to global brands—everything they need to design and deliver exceptional digital experiences! We’re passionate about empowering people to create beautiful and powerful images, videos, and apps, and transform how companies...
-
Big Data Engineer
2 weeks ago
Bengaluru, Karnataka, India Adobe Full timeJOB LEVELMid-level roleEMPLOYEE ROLEIndividual ContributorResponsibilities:Build and maintain cutting-edge data platform and data processing pipelines.Challenge the status quo by innovating and creating a cost-effective big data platform.Collaborate across teams to develop AI-based experiences.Establish a culture of scientific processes and customer...
-
Big Data Engineer
4 days ago
Bengaluru, India Global Pharma Tek Full timeAuto req IDBRTitleBig Data EngineerYour Role and ResponsibilitiesUnderstand a data warehousing solution and able to work independently in such an environmentResponsible in Project development and delivery experience of a few good size projectsPosting CountryIndiaState / ProvinceHaryānaCity / Township / VillageGurgaonTravel RequiredUp to % or day a...
-
Big Data Engineer
1 month ago
Bengaluru, India Hexaware Technologies Full timeDescriptionData Engineer:Primary : ADF, SQLSeconday : Databricks, Pyspark / Scala, CICD, Data Security, encryptionResponsibilities:•Work closely with scrum master, technical leads and provide daily progress updates on the tasks assigned.•Provide support in defining the scope and sizing of the work.•Working closely with various enterprise architects,...
-
Big Data Engineer
2 months ago
Bengaluru, Karnataka, India Adobe Full timeJOB LEVELP50EMPLOYEE ROLEIndividual ContributorP50 (ESDEP50) Big Data Engineer What You'll Do Build the underneath data platform and maintain data processing pipelines using best in class technologies. Special focus on R&D to challenge status-quo and build the next generation big data platform that is efficient and cost effective. Translate complex...
-
Big Data Engineer
1 week ago
Bengaluru, India Infogain Full timeBig Data Engineer (Lead) with skills Big Data, Data Warehouse, Azure Datalake for location Any Infogain Base Location (Noida, Gurugram, Bangalore, Mumbai, Pune)Posted on: May 22, Share on Linkedin Share on Twitter Share on FacebookROLES & RESPONSIBILITIESResponsibilities:· Strong experience ofminimum 5+ years in Snowflake & Snowpipehaving over all 9 to 12...
-
Big Data Engineer
7 days ago
Bengaluru, India Infogain Full timeBig Data Engineer (Lead) with skills Big Data, Data Warehouse, Azure Datalake for location Any Infogain Base Location (Noida, Gurugram, Bangalore, Mumbai, Pune)Posted on: May 23, Share on Linkedin Share on Twitter Share on FacebookROLES & RESPONSIBILITIESResponsibilities:· Strong experience ofminimum 5+ years in Snowflake & Snowpipehaving over all 9 to 12...
-
Big Data Engineer
5 days ago
Bengaluru, India Infogain Full timeBig Data Engineer (Lead) with skills Big Data, Data Warehouse, Azure Datalake for location Any Infogain Base Location (Noida, Gurugram, Bangalore, Mumbai, Pune)Posted on: May 24, Share on Linkedin Share on Twitter Share on FacebookROLES & RESPONSIBILITIESResponsibilities:· Strong experience ofminimum 5+ years in Snowflake & Snowpipehaving over all 9 to 12...
-
Big Data Engineer
5 days ago
Bengaluru, India Global Pharma Tek Full timeAuto req ID BR Title Big Data Engineer Your Role and Responsibilities Understand a data warehousing solution and able to work independently in such an environment Responsible in Project development and delivery experience of a few good size projects Posting Country India State / Province Haryāna City / Township / Village Gurgaon Travel...
-
Big Data Engineer
2 weeks ago
Bengaluru, India Infogain Full timeBig Data Engineer (Lead) with skills Big Data, Data Warehouse, Azure Datalake for location Any Infogain Base Location (Noida, Gurugram, Bangalore, Mumbai, Pune) Posted on: May 19, Share on Linkedin Share on Twitter Share on Facebook ROLES & RESPONSIBILITIES Responsibilities: · Strong experience of minimum 5+ years in Snowflake & Snowpipe ...
-
Big Data Engineer
2 weeks ago
Bengaluru, India Infogain Full timeBig Data Engineer (Lead) with skills Big Data, Data Warehouse, Azure Datalake for location Any Infogain Base Location (Noida, Gurugram, Bangalore, Mumbai, Pune) Posted on: May 20, Share on Linkedin Share on Twitter Share on Facebook ROLES & RESPONSIBILITIES Responsibilities: · Strong experience of minimum 5+ years in Snowflake & Snowpipe ...
-
Big Data Engineer
1 week ago
Bengaluru, India Infogain Full timeBig Data Engineer (Lead) with skills Big Data, Data Warehouse, Azure Datalake for location Any Infogain Base Location (Noida, Gurugram, Bangalore, Mumbai, Pune) Posted on: May 22, Share on Linkedin Share on Twitter Share on Facebook ROLES & RESPONSIBILITIES Responsibilities: · Strong experience of minimum 5+ years in Snowflake & Snowpipe ...
-
Big Data Engineer
1 week ago
Bengaluru, India Infogain Full timeBig Data Engineer (Lead) with skills Big Data, Data Warehouse, Azure Datalake for location Any Infogain Base Location (Noida, Gurugram, Bangalore, Mumbai, Pune) Posted on: May 23, Share on Linkedin Share on Twitter Share on Facebook ROLES & RESPONSIBILITIES Responsibilities: · Strong experience of minimum 5+ years in Snowflake & Snowpipe ...
-
Big Data Engineer
6 days ago
Bengaluru, India Infogain Full timeBig Data Engineer (Lead) with skills Big Data, Data Warehouse, Azure Datalake for location Any Infogain Base Location (Noida, Gurugram, Bangalore, Mumbai, Pune) Posted on: May 24, Share on Linkedin Share on Twitter Share on Facebook ROLES & RESPONSIBILITIES Responsibilities: · Strong experience of minimum 5+ years in Snowflake & Snowpipe ...
-
Big Data Engineer
5 days ago
Bengaluru, India Infogain Full timeBig Data Engineer (Lead) with skills Big Data, Data Warehouse, Azure Datalake for location Any Infogain Base Location (Noida, Gurugram, Bangalore, Mumbai, Pune) Posted on: May 26, Share on Linkedin Share on Twitter Share on Facebook ROLES & RESPONSIBILITIES Responsibilities: · Strong experience of minimum 5+ years in Snowflake & Snowpipe ...
-
Big Data Engineer
2 days ago
Bengaluru, India Infogain Full timeBig Data Engineer (Lead) with skills Big Data, Data Warehouse, Azure Datalake for location Any Infogain Base Location (Noida, Gurugram, Bangalore, Mumbai, Pune) Posted on: May 29, Share on Linkedin Share on Twitter Share on Facebook ROLES & RESPONSIBILITIES Responsibilities: · Strong experience of minimum 5+ years in Snowflake & Snowpipe ...
-
Big Data Engineer
3 days ago
Bengaluru, India Infogain Full timeBig Data Engineer (Lead) with skills Big Data, Data Warehouse, Azure Datalake for location Any Infogain Base Location (Noida, Gurugram, Bangalore, Mumbai, Pune) Posted on: May 28, Share on Linkedin Share on Twitter Share on Facebook ROLES & RESPONSIBILITIES Responsibilities: · Strong experience of minimum 5+ years in Snowflake & Snowpipe ...
-
Big Data Engineer
2 days ago
Bengaluru, India Infogain Full timeBig Data Engineer (Lead) with skills Big Data, Data Warehouse, Azure Datalake for location Any Infogain Base Location (Noida, Gurugram, Bangalore, Mumbai, Pune) Posted on: May 30, Share on Linkedin Share on Twitter Share on Facebook ROLES & RESPONSIBILITIES Responsibilities: · Strong experience of minimum 5+ years in Snowflake & Snowpipe ...
