Big Data Engineer

2 weeks ago


delhi, India NeoStats Full time
Job Description
About Neostats Analytics:
NeoStats is a new-age, Data & Analytics firm offering contemporary solutions and infinite possibilities. Our mission is to create lasting competitive advantage for our clients by transforming them into world-class, data-driven organizations. Established in 2022 to provide End to End Data & Analytics Services, we are headquartered out of UAE, with bases in India & UK. Comprising of industry veterans, we enable structural transformations in Analytics powered by our expertise, true partnership, and e2e implementation approach.
About the Job: We are looking for a skilled Big Data Engineer to join our team in Bangalore/Chennai. The ideal candidate will have at least 5-8 years and 8+years of experience in the industry and be proficient in Python, Scala, SQL database, NoSQL database, Apache Airflow, Apache Spark, ELK Stack, Hadoop Ecosystem, Apache Kafka, and Amazon Redshift.
Responsibilities:
· Design, build, and maintain large-scale, distributed, and batch processing systems using Hadoop Ecosystem technologies such as Spark and Kafka.
· Develop, construct, test, and maintain data architectures and databases, including ETL and ELT processes.
· Build and maintain data pipelines, data warehouses, and data lakes for efficient data retrieval and analysis.
· Implement and manage data security and privacy protocols to ensure data integrity and compliance with industry standards.
· Troubleshoot and debug data processing systems, applications, and databases.
· Collaborate with data scientists, software engineers, and analysts to build and maintain data infrastructure and systems.
· Optimize and scale data processing workflows for maximum efficiency and performance.
· Stay up-to-date with emerging trends and technologies in the field of big data and analytics.
· Develop and maintain documentation, including data dictionaries, data flow diagrams, and process diagrams.
Requirements:
· At least 5-8 years and 8+years of experience in big data engineering or a related field.
· In-depth knowledge of Hadoop Ecosystem technologies such as Spark and Kafka.
· Proficiency in programming languages such as Python and Scala.
· Experience with SQL and NoSQL databases.
· Experience with Apache Airflow, ELK Stack, and Amazon Redshift.
· Strong problem-solving and analytical skills.
· Ability to work independently and as part of a team.
· Excellent communication and collaboration skills.
What we offer:
• Competitive Salary and Benefits
• Opportunity to be part of a fast-paced and growing startup. Grow your career with the company
• Ownership - You will own your initiative and be given specific responsibilities
• Continuous coaching & mentoring – You will have the opportunity to interact and work closely with other senior data scientists and AI experts across the globe.
• Dynamic and respectful work environment – we truly value you.
  • Big Data Engineer

    1 month ago


    Delhi, India Angel and Genie Full time

    Lead/Senior Big Data EngineerExperience: 6 - 10 YearsLocation: PuneType: Full-timeJob ProfileWe are looking for a Big Data Engineer who will work on building, and managing Big Data Pipelines forus to deal with the huge structured data sets that we use as an input to accurately generate analytics atscale for our valued Customers. The primary focus will be on...

  • Data Engineer

    2 weeks ago


    Delhi, India Evnek Technologies Pvt Ltd Full time

    Job DescriptionThis is a remote position.Role: Data EngineerExperience: 2+YearsNotice period: ImmediateLocation: Anywhere from IndiaJob Type: Full TimeResponsibilities:Designing & building data architectures including the design & set-up of scalable (big) data lakes (full cloud or hybrid cloud), scheduled transformations & data governanceResponsible for...


  • Delhi, India Leading MNC Full time

    Looking for aFreelance Big Data Solutions Engineerto join a team of rockstar developers. The candidate should have aminimum of 4+experience.There are multiple openings. If you're looking for freelance/ part time opportunity (along with your day job) & a chance to work with the top 0.1% of developers in the industry, this one is for you! You will report into...


  • delhi, India Leading MNC Full time

    Looking for a Freelance Big Data Solutions Engineer to join a team of rockstar developers. The candidate should have a minimum of 4+experience.There are multiple openings. If you're looking for freelance/ part time opportunity (along with your day job) & a chance to work with the top 0.1% of developers in the industry, this one is for you! You will report...

  • Data Engineer –

    1 month ago


    Delhi, India HARMAN International Full time

    HARMAN’s engineers and designers are creative, purposeful and agile. As part of this team, you’ll combine your technical expertise with innovative ideas to help drive cutting-edge solutions in the car, enterprise and connected ecosystem. Every day, you will push the boundaries of creative design, and HARMAN is committed to providing you with the...

  • Architect : Big Data

    2 weeks ago


    Delhi, India Databricks Full time

    As a **Solutions Architect** (Analytics, AI, Big Data, Public Cloud), you will guide the technical evaluation phase in a hands-on environment throughout the sales process. You will be a **technical advisor **internally to the sales team, and work with the product team as an advocate of your customers in the field. You will help our customers to achieve...


  • New Delhi, India Databricks Full time

    As aSolutions Architect(Analytics, AI, Big Data, Public Cloud), you will guide the technical evaluation phase in a hands-on environment throughout the sales process. You will be atechnical advisorinternally to the sales team, and work with the product team as an advocate of your customers in the field. You will help our customers to achieve tangible...

  • Architect : Big Data

    2 weeks ago


    new delhi, India Databricks Full time

    As a Solutions Architect (Analytics, AI, Big Data, Public Cloud), you will guide the technical evaluation phase in a hands-on environment throughout the sales process. You will be a technical advisor internally to the sales team, and work with the product team as an advocate of your customers in the field. You will help our customers to achieve tangible...

  • Architect : Big Data

    2 weeks ago


    New Delhi, India Databricks Full time

    As a Solutions Architect (Analytics, AI, Big Data, Public Cloud), you will guide the technical evaluation phase in a hands-on environment throughout the sales process. You will be a technical advisor internally to the sales team, and work with the product team as an advocate of your customers in the field. You will help our customers to achieve tangible...

  • Big Data Hadoop

    1 month ago


    Delhi, India SAM Manpower and Career Services Full time

    Job Description **Job Description**: Contract Exp - 4+ Location Delhi Hybrid Big Data,hadoop **Requirements**: Big Data,hadoop About Company / Benefits IT MNC **Role**: Big Data Hadoop **Location**: Delhi, India **Work Exp.**: 4-6 Years **Job Type**: Full Time **Salary**: INR 0-0 **Equity**: 0% - 0%


  • Delhi, India Data Engineer Academy Full time

    Job Title: Operations AnalystLocation : RemoteCompany Overview:Data Engineering Academy is a pioneering force in data engineering education, founded by FAANG data engineers with extensive industry expertise. Our platform provides comprehensive programs tailored to empower aspiring data engineers, equipping them with the skills and confidence necessary to...


  • Delhi, India Data Engineer Academy Full time

    Job Title: Operations AnalystLocation : RemoteCompany Overview:Data Engineering Academy is a pioneering force in data engineering education, founded by FAANG data engineers with extensive industry expertise. Our platform provides comprehensive programs tailored to empower aspiring data engineers, equipping them with the skills and confidence necessary to...


  • Delhi, India Data Engineer Academy Full time

    Job Title: Operations AnalystLocation : RemoteCompany Overview:Data Engineering Academy is a pioneering force in data engineering education, founded by FAANG data engineers with extensive industry expertise. Our platform provides comprehensive programs tailored to empower aspiring data engineers, equipping them with the skills and confidence necessary to...


  • Delhi, India Databricks Full time

    As a **Solutions Architect** (Analytics, AI, Big Data, Public Cloud), you will guide the technical evaluation phase in a hands-on environment throughout the sales process. You will be a **technical advisor **internally to the sales team, and work with the product team as an advocate of your customers in the field. You will help our customers to achieve...

  • Big Data Developer

    6 hours ago


    delhi, India Impetus Full time

    Experience Required: 4-5 yrs.Location: GurgaonImmediate Joiners onlyJOB DESCRIPTION:Skillset:Should have strong experience in big data technologies.Basic skills in data pipeline – experience in building data pipelines for data migrationBig Data – Pyspark, SparkStrong command on SQL & HiveProgramming Language: Any - Java/Python/Scala

  • Big Data Engineer

    3 days ago


    delhi, India OmegaHires Full time

    Job Title: Big Data Engineer (Cornerstone to Lumi migration) Duration: Full-time on OmegaHires Payroll  Location: NCR (Hybrid - 3 days Onsite per week)   Should understand the  Credit Card domain and good to have knowledge on Compliance & Operational Risk . Good analytics experience to do data discovery, analyze the gaps in data, partner with Data...


  • delhi, India LevelUP HCS Full time

    AWS Data Engineer- KafkaWe are looking for a Data Engineer (AWS Data Platform) to join our busy and dynamic business intelligence – data platform team.If you are a passionate Data Engineer you have the chance to be part of a team that looks to build out our next-generation data platform, leveraging new technologies and techniques to maximize the business...

  • ETL Big Data

    2 days ago


    new delhi, India LTIMindtree Full time

    Hi AllLooking for ETL Big data testerExperience- 3-8Location-ChennaiWorking experience in Big Data Testing or ETL TestingVery Good in SQL or HiveGood in LinuxWell versed in Agile processShould work independently and interact with customerBig Data Application Knowledge and Tele com background would be an added advantage

  • Solutions Architect

    1 month ago


    Delhi Cantonment, Delhi, Delhi, India Databricks Full time

    As a **Solutions Architect** (Analytics, AI, Big Data, Public Cloud), you will guide the technical evaluation phase in a hands-on environment throughout the sales process. You will be a **technical advisor **internally to the sales team, and work with the product team as an advocate of your customers in the field. You will help our customers to achieve...

  • Big Data Developer

    3 weeks ago


    delhi, India HTC Global Services Full time

    The project team will be spread between Paris and Bangalore. So, the candidate with an experience of 4-7 years is expected to work and coordinate on daily basis with the remote teams. Ability to learn new technology / framework / methodology.• Hands-on individual responsible for producing excellent quality of code, adhering to expected coding standards...