
Big Data Engineer
22 hours ago
Job Title: Big Data Engineer
Key Responsibilities:- Design, build, and maintain large-scale data processing systems.
- Develop PySpark applications using Spark Dataframes in Python.
- Optimize spark jobs to process huge volumes of data.
- Utilize Amazon's Analytics services such as EMR, Athena, and AWS Glue.
- Work with version control tools like Git and AWS Lambda.
Requirements:
- Hands-on experience in Python, PySpark, and AWS databases.
- Strong understanding of data warehousing concepts including dimensions, facts, and schemas.
- Experience with columnar storage formats such as Parquet, Avro, and ORC.
- Knowledge of compression techniques including Snappy and Gzip.
- Good understanding of big data technologies and data engineering principles.
-
Big Data Engineer
3 weeks ago
India Amazon Music Full timeJob DescriptionDESCRIPTIONProfit Intelligence team in Amazon Retail is seeking a seasoned and talented Senior Data Engineer to join the Historical Contribution Profit (HCP) team. HCP is a fast growing team with a mandate to build tools to automate profit-and-loss forecasting and planning for the Physical Consumer business. We are building the next generation...
-
Big Data
4 weeks ago
India Technomech Placements Full timeJob Title Big Data DeveloperExperience 4 to 10 yearsLocation Pune Bangalore Gurgaon Develop optimize and maintain big data solutions Work with Hadoop Spark Hive and other big data technologies Design and implement scalable data pipelines Collaborate with cross-functional teams for data-driven solutions Strong programming skills in Java Scala...
-
Big Data Developer
4 weeks ago
India DigiHelic Solutions Pvt. Ltd. Full timeJob descriptionKey Responsibilities:Big Data Architecture: Design, develop, and maintain scalable and distributed data architectures capable of processing large volumes of data.Data Storage Solutions: Implement and optimize data storage solutions using technologies such as Hadoop, Spark, and PySpark.PySpark Development: Develop and implement efficient ETL...
-
Big Data Architect
7 days ago
India beBeeDataEngineering Full time ₹ 1,00,00,000 - ₹ 2,00,00,000Senior Big Data EngineerWe are seeking an experienced data professional to design, build and maintain large-scale data pipelines. The ideal candidate will have a strong understanding of big data technologies, including Spark, PySpark and SQL.Main Responsibilities:Create efficient data pipelines using Apache Spark and ETL workflowsProcess large datasets using...
-
Scala Big Data Lead Engineer
2 days ago
India UST Full timeIf you arehighlyinterested and availableimmediately , please submit your resume along with your total experience, current CTC, notice period, and current location details toNitin.patil@ust.comKey Responsibilities:Design, develop, and optimizedata pipelines and ETL workflows .Work withApache Hadoop, Airflow, Kubernetes, and Containersto streamline data...
-
Engineering Manager – Big Data, Azure
7 days ago
India DataE2E Technologies Full timeTechnical Manager – AzureLocation: 100% RemoteEmployment Type: Full-timeShift Timing : 3 pm – 11 pm ISTJob Summary:About the Role:We are seeking a highly experienced and strategic Engineering Manager with deep expertise in Big Data platforms, Microsoft Azure, and Databricks. The ideal candidate will lead a team of talented data engineers to design and...
-
Engineering Manager – Big Data, Azure
5 days ago
India DataE2E Technologies Full timeTechnical Manager – Azure Location: 100% Remote Employment Type: Full-time Shift Timing : 3 pm – 11 pm IST Job Summary: About the Role: We are seeking a highly experienced and strategic Engineering Manager with deep expertise in Big Data platforms , Microsoft Azure , and Databricks . The ideal candidate will lead a team of talented data engineers...
-
Big Data Solutions Architect
2 days ago
India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000Job OverviewThe Scala Big Data Engineer will design, develop and optimize data pipelines and ETL workflows. They will work with Apache Hadoop, Airflow, Kubernetes and Containers to streamline data processing.Key Responsibilities:Design and develop data pipelines and ETL workflowsWork with Apache Hadoop, Airflow, Kubernetes and Containers to streamline data...
-
Big Data Revolutionist
2 days ago
India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000The Travel Industry is Evolving. Be a Part of It.In today's digital age, the travel industry is witnessing a paradigm shift. The traditional approach to booking travel arrangements is being revolutionized by innovative technologies and forward-thinking companies. As a Data Engineer, you will play a crucial role in this transformation.Job DescriptionWe are...
-
Scala/Big Data Developer
2 days ago
India Idyllic Services Full timeJob Title: Big Data Engineer – Scala Location: Experience: 7–10 Years (Minimum 3+ years in Scala)Immediate to 30 Days Mode of Work: Hybrid #Click the link below to learn more about the role and take the AI Interview to begin your application journey: We are looking for a highly skilled Big Data Engineer (Scala) with strong expertise in Scala,...