Sr. Spark and Data Lake Administrator

Sr. Data Engineer A Data Engineer is a data professionals with extensive knowledge and expertise in "big data" technologies and frameworks that works with Python/Scala/Java. They are software engineers who design, build, integrate data from various resources, and manage big data. Experienced in writing spark code with python or Scala, Sql queries, Linux/Unix...

Sr. Data Engineer A Data Engineer is a data professionals with extensive knowledge and expertise in "big data" technologies and frameworks that works with Python/Scala/Java. They are software engineers who design, build, integrate data from various resources, and manage big data. Experienced in writing spark code with python or Scala, Sql queries,...

Sr.Software Engineer - Azure Experience: - 7 years of Experience What you should have? Azure Data Factory, Azure Dev Ops CI/CD, Azure Data Lake, Azure Synapse, Azure Databricks, Py Spark, Git Hub.Need 4+ Years of experience Good analytical skills with excellent knowledge of SQL.Well versed with Azure Services Must have experience and knowledge on ADF, ADLS,...

Position Summary:This candidate will be a key contributor to the Global Data Management & Analytics team by implementing innovative big data solutions to solve business challenges. Business challenges this individual will contribute to include data integrations, relational data source ingestion/mapping/transformation, cloud application integration, and...

Position Summary:He will have hands on experience in big data architecture and data warehousing principles as well as hands on experience in full information lifecycle for large scale big data environments - from data origination to data consumption.Key Duties Administer our data lake organizing access controls processes Support the ETL development team...

Position Summary : This candidate will be a key contributor to the Global Data Management & Analytics team by implementing innovative big data solutions to solve business challenges. Business challenges this individual will contribute to include data integrations, relational data source ingestion/mapping/transformation, cloud application integration,...

Data Lake Technical Leader MISSION As any other member of the team, you will : Explain Michelin employees what the Corporate Data Lake can do for them Setup workspaces for them Provide coaching and expertise through face to face meeting or on community channels Participate to the platform support effort in a "you build it you run it" approach ...

Designation : Big Data EngineerExperience : 5 - 8 YearsSalary Range : upto 30 LPAJob Location : Kharadi, PuneType Of Employment : FT, PermanentWorking Mode : Hybrid (3 days WFO)Working Days : Mon - FriReports To : Director - Data EngineeringThe Opportunity : We are looking for talented, motivated, and self-driven Big Data Engineers who specialize in...

Responsibilities : - Create prototypes and proof-of-concepts for iterative development.- Experience with NoSQL databases, such as DynamoDB, MongoDB, etc.- Create and maintain optimal data pipeline architecture.- Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure...

Responsibilities : - Create prototypes and proof-of-concepts for iterative development.- Experience with NoSQL databases, such as DynamoDB, MongoDB, etc.- Create and maintain optimal data pipeline architecture.- Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure...

We are a proactive, highly solutions oriented and collaborative team that works with all the various business groups across the organization. Our purpose is capturing massive amounts of data is to transform this vital information into concrete and valuable insights that will allow Seagate to make better and more strategic business decisions. About the...

About Fusemachines Fusemachines is a leading AI strategy, talent, and education services and products provider. Founded by Sameer Maskey Ph.D., Adjunct Associate Professor at Columbia University, Fusemachines has a core mission of democratizing AI. With a presence in 4 countries (Nepal, United States, Canada, and Dominican Republic and more than 400...

:Job Description : Designing and implementing highly performant data ingestion pipelines from multiple sources using Apache Spark and/or Azure Data bricks and/or HDInsights Experience with other Open Source big data products Hadoop (incl. Hive, Pig, Impala) Experience with Open Source nonrelational / NoSQL data repositories (incl. MongoDB, Cassandra, Neo4J)...

Primary Skills: DynamoDBJavaKafkaSparkAmazon RedshiftAWS Lake FormationAWS GluePython Job Description: Having solid experience as a Data Engineer with a clear career progression. Strong hands-on programming skills. Proficient in working with Kafka, Kinesis, Spark, AWS Glue, and AWS Lake Formation. Thorough understanding of Python, Scala/Java, AWS services...

Responsibilities :- Design, build, and operationalize large-scale enterprise data solutions and applications using one or more AWS data and analytics services in combination with 3rd parties Spark, EMR, DynamoDB, RedShift, Kinesis, Lambda, and Glue.- Build data pipeline frameworks to automate high-volume and real-time data delivery.- Create prototypes and...

Responsibilities :- Design, build, and operationalize large-scale enterprise data solutions and applications using one or more AWS data and analytics services in combination with 3rd parties Spark, EMR, DynamoDB, RedShift, Kinesis, Lambda, and Glue.- Build data pipeline frameworks to automate high-volume and real-time data delivery.- Create prototypes and...

We are hiring for our clienthiringhood.Roles andresponsibilities: Determining project requirements anddeveloping work schedules for the team.Delegating tasks and achieving daily weeklyand monthly goals.Responsible for designing building testingand deploying the software releases.PrimarySkills DynamoDB Java KafkaSpark Amazon Redshift AWS Lake Formation AWS...

AZURE DATA FACTORY, DATA LAKE, DATA WAREHOUSE, SQL DATABASE-(0097243)DescriptionDefining information requirements for data management and business intelligence purposes.Experience in designing & delivering data analytics solutions leveraging native hyper scalers tech stack like AWS and Azure. As well as 3rd party tools.Primary Location:...

Primary Skills : DynamoDB, Java, Kafka, Spark, Amazon Redshift, AWS Lake Formation, AWS Glue, PythonJob Description :- Good work experience showing growth as a Data Engineer.- Hands On programming experience- Implementation Experience on Kafka, Kinesis, Spark, AWS Glue, AWS Lake Formation.- Excellent knowledge in: Python, Scala/Java, Spark, AWS (Lambda, Step...

Primary Skills : DynamoDB, Java, Kafka, Spark, Amazon Redshift, AWS Lake Formation, AWS Glue, PythonJob Description :- Good work experience showing growth as a Data Engineer.- Hands On programming experience- Implementation Experience on Kafka, Kinesis, Spark, AWS Glue, AWS Lake Formation.- Excellent knowledge in: Python, Scala/Java, Spark, AWS (Lambda, Step...