Current jobs related to Big Data Engineer - Delhi, Delhi - prudential Manpower Pvt
-
Big Data Engineer
2 weeks ago
Delhi, Delhi, India Eqaim Technology & Services Full timeJob Description : Big Data Engineer We are looking for a highly skilled Big Data Engineer to join our team. In this role, you will contribute to building and optimizing scalable data solutions that empower businesses to optimize promotional activities and maximize return on investment. You will work on data collection, validation, and analysis, while...
-
Senior Big Data Developer
2 weeks ago
Delhi, Delhi, India beBeeDataEngineer Full time ₹ 1,50,000 - ₹ 28,00,000Big Data Engineer RoleThe role of a big data engineer is pivotal in designing, developing, and maintaining scalable and secure big data solutions on cloud-based platforms. The ideal candidate will have expertise in cloud architecture, big data technologies, and data engineering best practices.",
-
NucleusTeq - Big Data Engineer - Spark/Scala
2 weeks ago
Delhi, Delhi, India NucleusTeq Consulting Pvt. Ltd. Full timeRole : Big Data Engineer Responsibilities :- Big Data Engineer with 5-6 years of experience- Experience in leading a team of engineers and a good attitude toward learning the domain and implementation- Strong exposure and expertise in Spark (Primary), Scala/Java (Scala Primary), Airflow Orchestration and AWS.- Finalizing the scope of the system and...
-
Senior Big Data Engineer
2 weeks ago
Delhi, Delhi, India beBeeDataEngineering Full time ₹ 15,00,000 - ₹ 20,00,000Job Title:A seasoned professional with extensive experience in designing and developing scalable data pipelines using Python is sought after.About the Role:Develop and implement robust data ingestion techniques from APIs, databases, and file-based sources.Work on API development, testing, and deployment utilizing various tools and frameworks.Collaborate with...
-
Big Data Engineer for Distributed Systems
2 weeks ago
Delhi, Delhi, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000Job OverviewWe are seeking an experienced Big Data Engineer to design, develop, and maintain large-scale distributed data pipelines using Apache Spark and Scala.Main Responsibilities:Design, develop, and maintain scalable distributed data processing systems.Write clean, efficient, and maintainable code adhering to industry best practices.Implement data...
-
Big Data Expert
2 weeks ago
Delhi, Delhi, India beBeeExpert Full time US$ 1,00,000 - US$ 1,70,000We are seeking a highly skilled engineer to fill a key role in our organization. In this position, you will be responsible for designing and building robust data pipelines that handle high-volume financial data.Key Responsibilities:Design and develop end-to-end data pipelines for financial datasets.Integrate third-party APIs and data feeds into internal...
-
Big Data Application Developer
2 weeks ago
Delhi, Delhi, India beBeeData Full time ₹ 9,99,999 - ₹ 19,99,999Job TitleA Big Data Developer is required to work with large-scale data processing systems and design efficient data pipelines. Key Responsibilities:Develop and maintain big data applications using programming languages like Java and Scala.Design and implement data pipelines using Unix Shell scripting and query languages like Oracle SQL and Hive...
-
AWS Data Engineer
3 weeks ago
Delhi, Delhi, India Coforge Full timeJob Description- The ideal candidate will be responsible for designing, developing, and maintaining big data solutions on AWS.- This role requires a deep understanding of big data technologies, cloud architecture, and best practices in data engineering.Responsibilities:- Design, develop, and maintain big data solutions using AWS services. Implement data...
-
Data Engineer
2 weeks ago
Delhi, Delhi, India Haruto Technologies LLP Full timeRole : GCP Data EngineerLocation : RemoteExperience Required : 5+ YearsAbout the Role :We are looking for an experienced GCP Data Engineer who has strong expertise in building and optimizing data pipelines, big data processing, and data warehousing solutions on Google Cloud Platform. The ideal candidate should be hands-on with BigQuery, DataProc, PySpark,...
-
Data Lake/Big Data Architect
3 weeks ago
Delhi, Delhi, India Infosys Limited Full timeJob DescriptionResponsibilities :ROLE AND RESPONSIBILITIESAs a Data Lake/ Big Data Architect, lead the engagement efforts at different stages from problem definition to diagnosis to solution design, development & deployment in large government implementation programs.Create detailed design and architecture, and process artifacts, implement the solution and...

Big Data Engineer
2 weeks ago
Education and Experience :Bachelor's degree in computer science, or similar technical field
Minimum 5 years of experience in Big Data Engineering/Data Analysis5 Days Work From Office :Preferred Skills and Qualifications : Proficiency in Python, SQL and Apache SparkAWS services such as EMR, Glue (server less architecture), S3, Athena, IAM, Lambda and Cloud WatchCore Spark, Spark Streaming, DataFrame API, Data Set API, RDD APIs & Spark SQL programming dealing with processing terabytes of data
Advanced SQL using Hive/Impala framework including SQL performance tuning
Expertise in Hadoop, and other distributed computing frameworks ElasticSearch (OpenSearch) and Kibana DashboardsResource management frameworks such as Yarn or Mesos.Physical table design in Big Data environment
External job schedulers such as autosys, AWS data pipeline, airflow etc.Experience working in Key/Value data store such as HbaseData Analyst :Skills, Experience and Requirements :Minimum of 5 years of experience delivering data solutions on a variety of data warehousing platforms.Experience with SQL, Python and Excel in a business environment required2 years of experience with Tableau developing calculated fields
Experience with data cleaning and blending multiple data sources using ETL tools
Experience in cloud technologies (like AWS) and data analytics platforms (ex: Redshift and Snowflake)Experience in delivering of self-service analytics, insights, KPIs and metrics
Experience building and maintaining data catalog with dictionary Experience with scheduling tools like Control-M or AirflowStrong understanding and experience with data warehousing concepts required
Experience manipulating large datasets in a business environment required
Experience translating data to actionable insights required
Excellent facilitation skills; Strong desire to communicate in all settings
Apply objective, analytical, and orderly thinking to the analysis of complex problems
Embrace the Adventure; Willing to take risks, try innovative approaches, be adaptable to change, and learn from failures
Demonstrate Curiosity; Strong desire to learn and add value to all aspects of the Dish business
Education and Experience :Bachelor's Degree with 5 years of experience in a relevant field such as Business operations, Analyticsand Computer science; Master's Degree a plus )