Big Data Engineer
3 weeks ago
Hiring For Big Data Engineer (Spark, Scala, AWS)
Job description :
- Spark, SCALA, AWS OR Spark, python with AWS lambda exposure.
- Design, build, optimize and support new and existing data models and ETL processes based on our clients business requirements.
- Build, deploy and manage data infrastructure that can adequately handle the needs of a rapidly growing data driven organization.
- Coordinate data access and security to enable data scientists and analysts to easily access to data whenever they need too.
- Solid hands-on and Solution Architecting experience in Big-Data Technologies (AWS)
- Hands on experience in: AWS Dynamo DB, EKS, Kafka, Kinesis, Glue, EMR
- Hands-on experience of programming language like Scala with Spark.
- Good command and working experience on Hadoop Map Reduce, HDFS, Hive, HBase, and/or No-SQL Databases
- Hands on working experience on any of the data engineering analytics platform (Hortonworks Cloudera MapR AWS), AWS preferred
- Hands-on experience on Data Ingestion Apache Nifi, Apache Airflow, Sqoop, and Oozie
- Hands on working experience of data processing at scale with event driven systems, message queues (Kafka FlinkSpark Streaming)
- Hands on working Experience with AWS Services like EMR, Kinesis, S3, CloudFormation, Glue, API Gateway, Lake Foundation
Technical skills requirements :
- Hands on working Experience with AWS Athena
- Data Warehouse exposure on Apache Nifi, Apache Airflow, Kylo
- Operationalization of ML models on AWS (e.g. deployment, scheduling, model monitoring etc.)
- Feature Engineering Data Processing to be used for Model development
- Experience gathering and processing raw data at scale (including writing scripts, web scraping, calling APIs, write SQL queries, etc.)
- Experience building data pipelines for structured unstructured, real-time batch, events synchronous asynchronous using MQ, Kafka, Steam processing
- Hands-on working experience in analysing source system data and data flows, working with structured and unstructured data
- Must be very strong in writing SQL queries
- Strengthen the Data engineering team with Big Data solutions
- Strong technical, analytical, and problem-solving skills
- Strong organizational skills, with the ability to work autonomously as well as in a team-based environment - Pleasant Personality, Strong Communication & Interpersonal Skills.
-
Big data Full-Time
4 weeks ago
Jaipur, India HyreFox Consultants Full timePOSITION: Big Data EngineerUST Global islooking for an active person who can work as Big Data Engineer in USTPlatforms. The candidate must possess excellent written and verbalcommunication skills with the ability to collaborate effectively with domainand technical experts in the organization.Primary skills:Apache Hadoop, Apache Spark, Apache KafkaRoles &...
-
Big data Full-Time
1 month ago
jaipur, India HyreFox Consultants Full timePOSITION: Big Data Engineer UST Global islooking for an active person who can work as Big Data Engineer in USTPlatforms. The candidate must possess excellent written and verbalcommunication skills with the ability to collaborate effectively with domainand technical experts in the organization. Primary skills: Apache Hadoop, Apache Spark, Apache...
-
Managing Consultant
4 weeks ago
Jaipur, India HyreFox Consultants Full timeLead end to end successful delivery of Big data use cases. Lead the team of Big Data architects and developers to deliver the solutionoutcome, with emphasis on value delivery. Get involved in meetings and discussions, by providing Point-of- Views and conducting Proof-of- Concepts leading to creating a use case for implementing big data...
-
Managing Consultant
1 month ago
jaipur, India HyreFox Consultants Full timeLead end to end successful delivery of Big data use cases. Lead the team of Big Data architects and developers to deliver the solution outcome, with emphasis on value delivery. Get involved in meetings and discussions, by providing Point-of- Views and conducting Proof-of- Concepts leading to creating a use case for implementing big data...
-
Sr Consultant
4 weeks ago
Jaipur, India HyreFox Consultants Full timeParticipate in various technology assessments (for example Hadoop, Spark, Kafka, TensorFlow, etc.) Active interaction with other departments to set up and configure big data clusters and assist their datalake onboarding. Participate in the design, implementation and documentation of new use cases Any other work assigned, as per the project...
-
Sr Consultant
1 month ago
jaipur, India HyreFox Consultants Full timeParticipate in various technology assessments (for example Hadoop, Spark, Kafka, TensorFlow, etc.) Active interaction with other departments to set up and configure big data clusters and assist their datalake onboarding. Participate in the design, implementation and documentation of new use cases Any other work assigned, as per the project...
-
AU Small Finance Bank
2 weeks ago
Jaipur/Rajasthan, India Au Finance Bank Full timeSpark Engineer Design and Develop Spark Applications:- Understand the current Apache Spark platform code and nuances related to the same- Optimize and fine-tune Spark jobs for performance and efficiency.2. Python Programming:- Utilize Python for scripting, data manipulation, and integration with Spark applications.- Collaborate with cross-functional teams...
-
Big Data Architect Full-Time
4 weeks ago
Jaipur, India HyreFox Consultants Full timeQualification– B.Tech OR equivalent qualificationJob Description:• Expand and optimize our data ecosystem.• Designing the state-of-the-art data landscape using the modern age cloud components.• Strong understanding of Big Data Analytics platforms and ETL in the context of Big Data.• Frame architectural decisions, provide technology leadership &...
-
Big Data Engineer
3 weeks ago
Rajasthan,Karnataka,Metros,Jaipur,Udaipur,Bangalore,Raipur, India ATech Full timeHiring For Big Data Engineer (Spark, Scala, AWS)Job description :- Spark, SCALA, AWS OR Spark, python with AWS lambda exposure.- Design, build, optimize and support new and existing data models and ETL processes based on our clients business requirements.- Build, deploy and manage data infrastructure that can adequately handle the needs of a rapidly growing...
-
Big Data Engineer
3 weeks ago
Rajasthan/Karnataka/Metros/Jaipur/Udaipur/Bangalore/Raipur, IN ATech Full timeHiring For Big Data Engineer (Spark, Scala, AWS)Job description :- Spark, SCALA, AWS OR Spark, python with AWS lambda exposure.- Design, build, optimize and support new and existing data models and ETL processes based on our clients business requirements.- Build, deploy and manage data infrastructure that can adequately handle the needs of a rapidly growing...
-
Big Data Architect Full-Time
1 month ago
jaipur, India HyreFox Consultants Full timeQualification – B.Tech OR equivalent qualification Job Description: • Expand and optimize our data ecosystem. • Designing the state-of-the-art data landscape using the modern age cloud components. • Strong understanding of Big Data Analytics platforms and ETL in the context of Big Data. • Frame architectural decisions, provide...
-
Big Data Engineer
4 weeks ago
Goa/Mumbai/Jammu & Kashmir/Jammu/Srinagar/Pondicherry/Jaipur/Lucknow/Varanasi/Banaras/Patna/Ranchi, IN ATech Full timeDesignation: BIG DATA ENGINEERJob Description:Your Role and Responsibilities:- Understand a data warehousing solution and able to work independently in such an environment- Responsible in Project development and delivery experience of a few good size projects- Design, build, optimize and support new and existing data models and ETL processes based on our...
-
Big Data Engineer
2 weeks ago
Goa/Mumbai/Jammu & Kashmir/Jammu/Srinagar/Pondicherry/Jaipur/Lucknow/Varanasi/Banaras/Patna/Ranchi, India ATech Full timeDesignation: BIG DATA ENGINEERJob Description:Your Role and Responsibilities:- Understand a data warehousing solution and able to work independently in such an environment- Responsible in Project development and delivery experience of a few good size projects- Design, build, optimize and support new and existing data models and ETL processes based on our...
-
Senior Data Analyst
4 weeks ago
Jaipur, India Sanmax Technologies (P) Limited Full timeJob DescriptionThis Senior Data Engineer will need to have a successful history of data analysis, design, implementation and production deployment in critical, multi-business environments. This role will work closely with various Digital Product Insights, Analytics, Intelligence, Operations and Support teams in a highly collaborative environment to...
-
Senior Data Analyst
1 month ago
jaipur, India Sanmax Technologies (P) Limited Full timeJob Description This Senior Data Engineer will need to have a successful history of data analysis, design, implementation and production deployment in critical, multi-business environments. This role will work closely with various Digital Product Insights, Analytics, Intelligence, Operations and Support teams in a highly collaborative...
-
Senior Data Analyst
1 month ago
Jaipur, India Sanmax Technologies (P) Limited Full timeJob Description This Senior Data Engineer will need to have a successful history of data analysis, design, implementation and production deployment in critical, multi-business environments. This role will work closely with various Digital Product Insights, Analytics, Intelligence, Operations and Support teams in a highly collaborative environment to...
-
Data Architect
2 weeks ago
jaipur, India Programmers.io Full timeData Solutions Architect Ability to Conduct Client Workshops and participation in Due Diligence exercises to define a Data Strategy & roadmap that is aligned to their Business & IT Strategy • Heavy pre-sales involvement, right from qualifying the pursuit, to Lead the Pursuit, Collate Questionnaire, collaborate team for responses, conduct review sessions...
-
Data Architect
2 weeks ago
Jaipur, India Programmers.io Full timeData Solutions Architect Ability to Conduct Client Workshops and participation in Due Diligence exercises to define a Data Strategy & roadmap that is aligned to their Business & IT Strategy• Heavy pre-sales involvement, right from qualifying the pursuit, to Lead the Pursuit, Collate Questionnaire, collaborate team for responses, conduct review sessions...
-
Senior Engineer
3 days ago
Jaipur, India Altimetrik Full timeExperiance - 4+ yrsPrimery Skills - Data Science, Machine Learning, SQLSecondary Skills - SQL, PythonQualifications:Bachelor’s degree in a related field, such as computer science, software engineering or data science, is recommended. Master’s degree in Artificial Intelligence a plus4+ years of experience working in AI /Machine Learning Engineering...
-
AI & ML Engineer Full-Time
3 days ago
Jaipur, India HyreFox Consultants Full timeHumanli.AI isa Startup founded by Alumnus of IIM' Bangalore/ISB Hyderabad & IIM'Calcutta. We are democratizing and extending technology that were accessible& consumed only by MNC’s or Fortune companies to SME and Mid-size firms. Weare pioneers in bringing Knowledge Management algorithms & Computer Visioninto Conversational BOT framework. All our Bot’s...