Junior Data Engineer Job at VDart Inc, New York, NY

MW4ySWhLZWl2Q1h2S3o0NUE1OW5Udk1iWXc9PQ==
  • VDart Inc
  • New York, NY

Job Description

Job Description

Job Description

Job Title: Junior Data Engineer

Location: New York City, NY (Onsite)

Type: Contract

  • The Data Engineer will expand and optimize the data and data pipeline architecture, as well as optimize data flow and collection for cross functional teams.
  • The Data Engineer will perform data architecture analysis, design, development and testing to deliver data applications, services, interfaces, ETL processes, reporting and other workflow and management initiatives.
  • The role also will follow modern SDLC principles, test driven development and source code reviews and change control standards in order to maintain compliance with policies.
  • This role requires a highly motivated individual with strong technical ability, data capability, excellent communication and collaboration skills including the ability to develop and troubleshoot a diverse range of problems.

Responsibilities:

  • Design and develop enterprise data / data architecture solutions using Hadoop and other data technologies like Spark, Scala, JAVA, Python, SQL etc.
  • Handle the end to end development of ETL/ELT process from discovery, design, coding all the way to production deployment Address assigned tickets and deliver code in a timely manner Work with business, product and technical stakeholders Research and provide thoughtful solutions Identify dependencies and raise risks early Participate in on-call rotation Research and fix production issues and take initiative in identifying and solving problems Review code and approve pull requests Drive implementation of standards and best practices Collaborate with team members Should have excellent analytical skills, able to recognize data patterns and troubleshoot the data.

Qualifications:

  • Undergraduate degree required, MS or other advanced degree preferred.
  • 3+ year of experience as a member of an information technology team.
  • 3+ year of relevant experience architecting the complete end to end design of enterprise wide solution using latest technologies Hadoop, Spring boot/Spring Cloud, Rest API, SQL 3+ year of professional experience in Python or Core Java, AWS, Rest API, Microservices, Spring Boot, Spring cloud etc.
  • Experience with data modeling, complex data structures, data processing, and data quality and data lifecycle Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases.
  • Experience building and optimizing big data data pipelines, architectures and data sets. Passion and drive for continuous improvement and transformational change, with a business owner mentality. Strong written and verbal communication skills

Position Overview Summary:

  • The Data Engineer will expand and optimize the data and data pipeline architecture, as well as optimize data flow and collection for cross functional teams.
  • The Data Engineer will perform data architecture analysis, design, development and testing to deliver data applications, services, interfaces, ETL processes, reporting and other workflow and management initiatives.
  • The role also will follow modern SDLC principles, test driven development and source code reviews and change control standards in order to maintain compliance with policies. This role requires a highly motivated individual with strong technical ability, data capability, excellent communication and collaboration skills including the ability to develop and troubleshoot a diverse range of problems.

Responsibilities:

  • Design and develop enterprise data / data architecture solutions using Hadoop and other data technologies like Spark, Scala, JAVA, Python, SQL etc.
  • Handle the end to end development of ETL/ELT process from discovery, design, coding all the way to production deployment Address assigned tickets and deliver code in a timely manner Work with business, product and technical stakeholders Research and provide thoughtful solutions Identify dependencies and raise risks early Participate in on-call rotation Research and fix production issues and take initiative in identifying and solving problems Review code and approve pull requests Drive implementation of standards and best practices Collaborate with team members Should have excellent analytical skills, able to recognize data patterns and troubleshoot the data.
  • Qualifications Undergraduate degree required, MS or other advanced degree preferred.
  • 3+ year of experience as a member of an information technology team.
  • 3+ year of relevant experience architecting the complete end to end design of enterprise wide solution using latest technologies
  • Hadoop, Spring boot/Spring Cloud, Rest API, SQL 3+ year of professional experience in Python or Core Java, AWS, Rest API, Microservices, Spring Boot, Spring cloud etc. Experience with data modeling, complex data structures, data processing, and data quality and data lifecycle Advanced working SQL knowledge and experience working with relational databases, query authoring (SQL) as well as working familiarity with a variety of databases.
  • Experience building and optimizing big data data pipelines, architectures and data sets. Passion and drive for continuous improvement and transformational change, with a business owner mentality.
  • Strong written and verbal communication skills

Job Tags

Contract work,

Similar Jobs

Regions Bank

Site Reliability Engineer - Observability Job at Regions Bank

 ...your information by visiting and logging into the careers section of the system. **Job Description:** At Regions, the Site Reliability Engineer is responsible for ensuring the dependability of our firm's most critical system applications. This role will be called upon... 

Spherion Staffing & Recruiting

Material Handler Warehouse Job at Spherion Staffing & Recruiting

 ...manner Reposition trailers using material handling equipment Process packages through parcels shipping carriers' systems such as FedEx and UPS Perform audits and verifying shipping accuracy to maintain highest level of customer satisfaction Maintain accurate... 

Host Healthcare

Travel Nurse RN - Psychiatric - $1,791 per week Job at Host Healthcare

 ...Job Description Host Healthcare is seeking a travel nurse RN Psychiatric for a travel nursing job in Jeffersonville, Indiana. Job Description & Requirements ~ Specialty: Psychiatric ~ Discipline: RN ~ Start Date: 11/18/2024~ Duration: 13 weeks ~36 hours... 

Elevation Consulting Group

Accounting/Data Entry Clerk Job at Elevation Consulting Group

 ...Job Title: Accounting/Data Entry Clerk Location: Remote (Work from Home) Company: Elevation Consulting Group About Us: Elevation Consulting Group is a premier travel agency dedicated to providing exceptional travel experiences tailored to our clients' needs. Our... 

DISH

Call Center Representative Job at DISH

 ...streaming and on-demand programming, smart home installation services, mobile plans and...  ...include a rotation of at-home and onsite work based on performance and business needs....  ...by providing exceptional service and one-call resolution Maintain strong knowledge of...