Senior Data Engineer

4 weeks ago

Remote, India Nthinsight Full time

Job Description :

We are seeking a skilled and experienced Data Engineer with expertise in Python, data warehousing, ETL (Extract, Transform, Load), and SQL. As a Data Engineer, you will play a crucial role in designing, developing, and maintaining our data infrastructure to support the organization's data needs. You will collaborate with cross-functional teams to ensure the effective collection, storage, and retrieval of data for analytics and reporting purposes.

Responsibilities :

1 Work with product managers and data analysts to build data products that power our business.

2 Build and maintain data analytics reports, ETL /ELT pipelines, data lakes, and streaming solutions.

3 Analyze new data sources and work with stakeholders to understand the impact of integrating new data into existing pipelines and models

4 Develop & maintain critical data pipelines, using tools such as Apache Airflow, to ensure highly accurate and reliable business reporting

5 Perform ad-hoc analysis and provide insights to stakeholders within the organization such as Marketing, Growth & Sales teams to drive prioritization.

6 Create data visualizations and analytic reports using various tools such as Tableau

7 Optimize database queries to improve and maintain performance on very large data sets.

8 Work closely with the business and analysis team for the deliverables.

Requirements :

1. 8+ years of relevant experience. Masters or Bachelors degree in CS/ML/AI or equivalent discipline.

2. Expertise with coding with Pyspark, Pandas and visualizations with Tableau.

3. Scheduling/orchestrating pipelines using Databricks and Airflow.

4. Expertise with data querying (Snowflake, SQL, Redshift, Spark) and analyzing billions of rows of data points.

5. Familiarity with SQL, especially within cloud-based data warehouses like Snowflake, Google Big Query, and Amazon Redshift

6. Strong understanding of relational DB such as MySQL/PostgreSQL, document-based storage systems such as MongoDB or CouchDB, key-value stores (Memcached, Redis), Column-oriented stores (HBase, Cassandra), graph-oriented stores; their distinct advantages, disadvantages, and trade-offs.

7. Experience building machine learning, statistical, and analytical model, and tuning parameters.

8. Experience designing experiments and extracting insights.

9. Knowledge of various ETL/ ELT techniques and frameworks

If you are a motivated end to end Data Analyst with a passion for building robust and scalable data solutions, we invite you to apply and contribute to our dynamic and innovative team.

(ref:hirist.tech)

  • Senior Data Engineer

    3 weeks ago

    Bangalore/Remote, IN Geektrust.in Full time

    Role : Senior Data EngineerFocus : AWS ecosystemKey Responsibilities : Designing, developing, and maintaining data pipelines; ensuring the reliability, efficiency, and scalability of data infrastructure; collaborating with cross-functional teams.Primary Skills : Programming Languages : PythonDatabase : SQL.- AWS Services : Proficient with a variety of AWS...

  • Senior Data Engineer

    4 weeks ago

    Bangalore,Remote, India geektrust.in Full time

    Role : Senior Data EngineerFocus : AWS ecosystemKey Responsibilities : Designing, developing, and maintaining data pipelines; ensuring the reliability, efficiency, and scalability of data infrastructure; collaborating with cross-functional teams.Primary Skills : Programming Languages : PythonDatabase : SQL.- AWS Services : Proficient with a variety of...

  • Senior Data Engineer

    3 weeks ago

    Remote, IN Nthinsight Full time

    Job Description :We are seeking a skilled and experienced Data Engineer with expertise in Python, data warehousing, ETL (Extract, Transform, Load), and SQL. As a Data Engineer, you will play a crucial role in designing, developing, and maintaining our data infrastructure to support the organization's data needs. You will collaborate with cross-functional...

  • Senior Data Engineer

    2 weeks ago

    Remote, India Nthinsight Full time

    Job Description : We are seeking a skilled and experienced Data Engineer with expertise in Python, data warehousing, ETL (Extract, Transform, Load), and SQL. As a Data Engineer, you will play a crucial role in designing, developing, and maintaining our data infrastructure to support the organization's data needs. You will collaborate with...

  • Data Scientist

    2 weeks ago

    Remote, India Luxoft Full time

    **Project** Description**: **Responsibilities**: Proficiency in statistical analysis and computing, algorithm categories such as Supervised Learning, Unsupervised Learning, Optimization Algorithms, Deep Learning, Search Algorithms, MLOps/MLFlow Experience in: Python, Spark, Pyspark, SQL, Databricks, R(Optional) Experience in working with cloud technologies...

  • Senior Power BI Developer

    7 days ago

    remote, IN AdAstra Full time

    Job Description :As a Senior Power BI Developer, you will be responsible for : Technical Requirements :- Gathering and Development of Functional Specifications - Translating business needs into technical specifications. - Developing reporting systems that provide accessible information for decision-making. - Using warehouse data to generate reports to...

  • Senior Power BI Developer

    7 days ago

    remote, India AdAstra Full time

    Job Description : As a Senior Power BI Developer, you will be responsible for : Technical Requirements : - Gathering and Development of Functional Specifications - Translating business needs into technical specifications. - Developing reporting systems that provide accessible information for decision-making. - Using warehouse data to generate...

  • Data Modeler

    4 weeks ago

    Remote, India Luxoft Full time

    **Project** Description**: Luxoft DXC Technology Company is an established company focusing on consulting and implementation of complex projects in the financial industry. At the interface between technology and business, we convince with our know-how, well-founded methodology and pleasure in success. As a reliable partner to our renowned customers, we...

  • Senior Network Security Engineer

    1 week ago

    remote, India TAMI Training Full time

    Current Opening for Senior Network Engineer. Our US Based Client is currently looking for professionals who can work remotely from India. The following are the skills required: 1. Checkpoint FW - CCSA or CCSE certified - High Priority 2. Cisco - CCNP or CCIE in any vertical 3. F5 - LTM, GTM, ASM, APM 4. Palo Alto FW - PCNSA or PCNSE 5. Fortinet - Firewall...

  • Senior Manager, IT Operations

    3 weeks ago

    REMOTE, India Parexel Full time

    We are currently hiring a Senior Manager, IT Operations to lead our Desktop Engineering team. The successful individual will ensure the Desktop Engineering team deliver best value services for the benefit of our clients, employees, and investors through the application of computer and communications technologies, along with innovations in information...

  • Senior Frontend Engineer

    2 weeks ago

    Remote, India Etta Global Partners LLC Full time

    Job Description : Etta Global is seeking a highly skilled Senior Frontend Engineer with 8 to 10 years of experience and relevant certifications to join our dynamic team. The ideal candidate should possess advanced proficiency in React.js and its core principles, along with a proven track record of building complex and highly interactive user...

  • Salesforce QA with Copado

    4 days ago

    Remote, India Data PlatformExperts Full time

    **Job description** We are seeking a skilled and experienced Salesforce QA Automation Engineer with expertise in Copado Robotic Testing to join our dynamic team. In this role, you will play a critical part in ensuring the quality and reliability of our Salesforce solutions by designing, developing, and executing automated test scripts using Copado Robotic...

  • Data Scientist

    4 days ago

    Remote, India Karmaeduconsultant Full time

    Job Description: As a Data Scientist at our company, you will play a pivotal role in leveraging data-driven insights to drive business decisions and optimize operational efficiencies. You will work closely with cross-functional teams to design, develop, and deploy advanced analytics models and solutions that address complex business challenges. Your...

  • Gcp Data Architect

    4 weeks ago

    Remote, India RARR Technologies Pvt Ltd Full time

    We are seeking a skilled Data Engineer to join our team, proficient in **BigQuery, Dataflow, and Airflow,** with expertise in either **Python or Java programming languages**. As a Data Engineer, you will play a key role in designing, implementing, and optimizing data pipelines for our organization s data infrastructure. **Responsibilities**: - Design and...

  • Data Scientist

    4 weeks ago

    Remote, India UMENIT SOLUTIONS LLP Full time

    Responsibilities: - Data Modeling: Develop, implement, and optimize machine learning models and algorithms to solve complex business problems and enhance decision-making processes.Data Collection and Preprocessing: Gather, clean, and preprocess data from various sources to ensure quality and relevance for model training and analysis.Feature Engineering:...

  • Senior Software Engineer

    2 weeks ago

    REMOTE, India Parexel Full time

    Role and ResponsibilitiesUsing Microsoft Azure data PaaS services, design, build, modify, and support data pipelines leveraging DataBricks and PowerBI in a medallion architecture setting.If necessary, create prototypes to validate proposed ideas and solicit input from stakeholders.Excellent grasp of and expertise with test-driven development and continuous...

  • Data Scientist

    6 hours ago

    Remote, India UMENIT SOLUTIONS LLP Full time

    Responsibilities: - Data Modeling: Develop, implement, and optimize machine learning models and algorithms to solve complex business problems and enhance decision-making processes.Data Collection and Preprocessing: Gather, clean, and preprocess data from various sources to ensure quality and relevance for model training and analysis.Feature Engineering:...

  • Samagra - Senior Software Engineer - Full Stack Development

    3 weeks ago

    Remote, IN Samagra Transforming Governance Full time

    We are searching for an experienced Senior Software Engineer to join our team. The ideal candidate will have a strong background in backend software development using solid server-side technologies including TypeScript, Postgres, and Docker/Kubernetes deployment. You will play a pivotal role in designing, developing, and maintaining critical software...

  • Samagra - Senior Software Engineer - Full Stack Development

    2 weeks ago

    Remote, India Samagra Transforming Governance Full time

    We are searching for an experienced Senior Software Engineer to join our team. The ideal candidate will have a strong background in backend software development using solid server-side technologies including TypeScript, Postgres, and Docker/Kubernetes deployment. You will play a pivotal role in designing, developing, and maintaining critical software...

  • Data Scientist

    4 weeks ago

    Remote, India Flipped.ai Full time

    We are seeking a talented and experienced Data Scientist having 5+ year of experience with core expertise in building recommendation engines to join our dynamic team. In this role, you will be responsible for developing, maintaining, and enhancing machine learning models to parse both text-based and image-based documents. Utilizing various text and document...