Data Engineer/Big Data Technology Teaching Assistant

4 weeks ago

Delhi, India BeaconFire Inc. Full time
Data Engineer/Big Data Technology Teaching Assistant

Job Title: Teaching Assistant - Data Engineering/Big Data Technologies

Job Description: We are seeking a Teaching Assistant with a solid foundation in Data Engineering to assist our team members with tasks such as conducting interviews for incoming candidates, addressing technical queries, and collaborating closely with Training Managers to facilitate the development and education of candidates in training. The ideal candidate should be highly skilled in Big Data technologies, proficient in data processing frameworks, and possess excellent communication skills. They should be professional, well-presented, and adept in both individual and collaborative settings.

Must Have:

3-5 years of experience with Big Data tools and data warehousing technologies such as Apache Hadoop, Spark, Hive and Snowflake/BigQuery.

Proficient understanding of lakehouse architecture and technologies such as Databricks or Delta Lake.

Strong experience of ETL processes and experience with ETL tools like AWS Glue or SSIS.

Proficient in programming languages used in Big Data, including Python, SQL, Scala, or Java.

In-depth knowledge of data storage solutions such as HDFS, Amazon S3, or SQL and NoSQL databases (e.g., Postgresql, MongoDB).

Familiarity with data processing and analytics frameworks like Apache Spark or Flink and data pipeline construction and maintenance using tools like Apache Airflow or dbt.

Experience with building and maintaining data pipelines in a distributed data architecture.

Understanding of data modeling and data architecture optimized for big data platforms.

Experience with stream-processing systems using Kafka or similar technologies.

Knowledge of CI/CD pipelines and version control systems like Git.

Familiarity with AGILE/SCRUM workflows and the software development lifecycle like Jira.

Excellent English communication skills and strong interpersonal abilities.

Professional demeanor and well-presented in all communications and interactions.

Nice to Have:

Experience with cloud platforms like AWS, Azure, or Google Cloud Platform.

Familiarity with orchestration tools such as Apache Airflow or Luigi.

Understanding of containerization (e.g., Docker) and orchestration tools (e.g., Kubernetes).

Knowledge of advanced analytics and machine learning frameworks.

Experience with data visualization tools and technologies.

Additional certifications in Big Data technologies or cloud services.

Technical Interview Process: Candidates must exhibit robust technical expertise in data engineering and exceptional communication skills to effectively support the Training Team in the United States.

  • Big Data Engineer

    2 weeks ago

    Delhi, Delhi, India Manuh Technologies Full time

    Job Title: Big Data EngineerAt Manuh Technologies, we are seeking a highly skilled Big Data Engineer to join our team. As a Big Data Engineer, you will be responsible for designing, developing, and implementing large-scale data processing systems using Hadoop, Spark, and other big data technologies.Key Responsibilities:Design and develop data pipelines using...

  • Big Data Engineer

    1 week ago

    Hyderabad/Pune/Delhi NCR, India Ace Recruit Full time

    Job Title: Big Data EngineerJob Summary:We are seeking a highly skilled Big Data Engineer to join our team at Ace Recruit. As a Big Data Engineer, you will be responsible for designing and building scalable data ingestion pipelines, conceptualizing and executing high-performance data processing, and scheduling and orchestrating pipelines.Key...

  • Big Data Engineer

    4 weeks ago

    Delhi, India Manuh Technologies Full time

    Position - Big Data EngineerLocation - Pune/Hyderabad/AnyExperience - 5+Job SummaryAs a Big data engineer responsibilities include - review and analysis of requirements, design workshop participation and facilitation, design creation and documentation, data pipeline implementation, testing, bug fixing, release support and post release aftercare.You will be...

  • Big Data Developer

    2 weeks ago

    Delhi, India Amossys Consulting Services Full time

    Position Title: Data EngineerExperience Required: 5+ years Employment Type: Full-time Employment Mode: HybridLocation: Bangalore, Pune, Trivandrum.Industry: Banking & Insurance sectorJob Summary:We are looking for a skilled Data Engineer with hands-on experience in PySpark and Big Data platforms to join our growing team. The ideal candidate will have strong...

  • Big Data Engineer

    2 weeks ago

    Hyderabad/Pune/Delhi NCR, India Ace Recruit Full time

    Job Title: Big Data EngineerAs a key member of our team, you will play a crucial role in designing and building scalable data ingestion pipelines, high-performance data processing, and data harmonization using various Open Source, Big Data, and Cloud technologies on Microsoft Azure.Key Responsibilities:Design and build scalable data ingestion pipelines for...

  • Data Engineer

    2 weeks ago

    Delhi, Delhi, India Tata Consultancy Services Full time

    Job DescriptionAs a Data Engineer at Tata Consultancy Services, you will play a key role in designing, building, and optimizing systems for data collection, storage, access, and analytics at scale.Key Responsibilities:Design and develop data pipelines that convert raw data into formats usable by data scientists, data-centric applications, and other data...

  • Big Data Engineer

    2 weeks ago

    Delhi, Delhi, India Luxoft Full time

    Collateral Management Platform DeveloperWe are seeking a skilled developer to join our team in Pune, working on a cutting-edge liquidity risk and collateral management platform for a leading investment bank.Responsibilities:Develop new functionality for the Liquidity Risk platform in collaboration with global teams.Design and implement efficient data...

  • Big Data Solutions Architect

    2 weeks ago

    Delhi, Delhi, India CallTek Full time

    About the RoleWe are seeking a highly skilled Big Data Engineer to design, develop, and maintain big data solutions. The ideal candidate will work closely with our team of data scientists and analysts to extract insights from large datasets.Key ResponsibilitiesDesign and develop big data solutions using Hadoop, Spark, or other big data technologies.Extract,...

  • Big Data Engineer

    2 weeks ago

    Delhi, Delhi, India Smartavya Analytica Private Limited Full time

    Job Title: Hadoop DeveloperAt Smartavya Analytica Private Limited, we are seeking a highly skilled Hadoop Developer to join our team.Key Responsibilities:Develop, test, and implement Big Data projects using Hadoop, Spark, and Hive.Lead the implementation of one or more tracks within projects, identifying and assigning tasks within the team, and providing...

  • Big Data Architect

    2 weeks ago

    Delhi, Delhi, India Affine Full time

    Job Title: Big Data ArchitectAt Affine, we are seeking a highly skilled Big Data Architect to join our team. As a key member of our data engineering team, you will be responsible for designing and implementing large-scale data pipelines, data warehouses, and data platforms.Key Responsibilities:Design and implement data pipelines using Spark, Python, Scala,...

  • Big Data DevOps Engineer

    2 weeks ago

    Delhi, Delhi, India Freelancer Recruiter Full time

    Job Title: Big Data DevOps EngineerWe are seeking a highly skilled Big Data DevOps Engineer to join our team at Freelancer Recruiter. The ideal candidate will have a strong background in managing the Big Data application stack, including HDFS, YARN, Spark, Hive, and HBase.Key Responsibilities:Design and implement scalable and highly available Big Data...

  • Architect : Big Data

    5 months ago

    Delhi, India Databricks Full time

    As a **Solutions Architect** (Analytics, AI, Big Data, Public Cloud), you will guide the technical evaluation phase in a hands-on environment throughout the sales process. You will be a **technical advisor **internally to the sales team, and work with the product team as an advocate of your customers in the field. You will help our customers to achieve...

  • Senior Big Data Engineer

    5 days ago

    Mumbai/Pune/Kolkata/Delhi/Nagpur/Ahmedabad, India AEXONIC TECHNOLOGIES PRIVATE LIMITED Full time

    Job Title: Senior Big Data EngineerAbout the Role:We are seeking a highly skilled Senior Big Data Engineer to join our team at AEXONIC TECHNOLOGIES PRIVATE LIMITED. As a key member of our data engineering team, you will be responsible for designing, building, and maintaining robust data pipelines that support large-scale data processing and analytics using...

  • Senior Data Engineer

    5 days ago

    Chennai/Gurgaon/Gurugram/Delhi NCR/Hyderabad, India Eucloid Data Solutions Pvt Ltd Full time

    About Eucloid Data SolutionsEucloid Data Solutions is a fast-growing AI-consulting firm that enables business growth for its clients through advanced Data Analytics, Machine Learning and Data engineering. We offer bespoke, full stack and data-driven approach to solve highly complex and large-scale business problems for some of the biggest Fortune 500...

  • Big Data Engineer

    4 weeks ago

    Hyderabad/Pune/Delhi NCR, IN Ace Recruit Full time

    Job Description :As a Big Data Engineer (Azure), you will build and learn about a variety of analytics solutions & platforms, data lakes, modern data platforms, data fabric solutions, etc. using different Open Source, Big Data, and Cloud technologies on Microsoft Azure. On a typical day, you might :- Design and build scalable & metadata-driven data ingestion...

  • Big Data Engineer

    5 days ago

    Hyderabad/Pune/Delhi NCR, India Ace Recruit Full time

    Job Description : As a Big Data Engineer (Azure), you will build and learn about a variety of analytics solutions & platforms, data lakes, modern data platforms, data fabric solutions, etc. using different Open Source, Big Data, and Cloud technologies on Microsoft Azure. On a typical day, you might :- Design and build scalable & metadata-driven data...

  • Big Data Solutions Architect

    2 weeks ago

    Delhi NCR, India ACS Consultants Full time

    Job Title: Big Data EngineerAt ACS Consultants, we are seeking a highly skilled Big Data Engineer to join our team. As a Big Data Engineer, you will be responsible for designing and implementing data engineering solutions on big data custom applications.Key Responsibilities:Design and develop data engineering solutions on big data custom applicationsModify...

  • Big Data Developer

    2 weeks ago

    Delhi, Delhi, India Luxoft Full time

    Job Title: Big Data DeveloperWe are seeking a highly skilled Big Data Developer to join our team in Pune, India. The successful candidate will work on the development of a liquidity risk and collateral management platform for one of the world's largest investment banks.Responsibilities:Design and develop new functionality for the Liquidity Risk platform in...

  • Big Data

    1 month ago

    delhi, India Myananta Technologies Full time

    At Myananta Technologies, we’re looking for a Big Data (Hadoop). The ideal candidate is excited by experimentation and looking for a new challenge that stretches their talents. Job description Full-Time Big Data (Hadoop) Developer Myananta Technologies | Gurugram is hiring for “Big Data (Hadoop) Developer” Experience : 3 - 5 Years. Salary : 5.0 -...

  • Big Data Engineer

    2 weeks ago

    Chennai/Hyderabad/Bangalore/Coimbatore/Mumbai/Delhi/Pune, India GAIUS HYPERLOCAL PRIVATE LIMITED Full time

    Job Title: Big Data EngineerWe are seeking a highly skilled Big Data Engineer to join our team at GAIUS HYPERLOCAL PRIVATE LIMITED. As a Big Data Engineer, you will be responsible for designing, developing, and maintaining scalable and efficient big data solutions.Key Responsibilities:Design and develop scalable big data architectures and pipelines.Develop...