We are looking for a Data Engineer that will architect and implement systems handling the ingestion, cleaning, and structuring of data. They will be a member of the Data Science team and will have direct interaction with the people using the data ingested. The hire will also be responsible for managing our group’s core infrastructure including our region redundant pipeline orchestration servers (Airflow) and webserver stack (NGINX + Gunicorn + Django). The ideal candidate is an experienced data pipeline builder and core infrastructure guru.

Responsibilities:

• Create and maintain an optimal data pipelines in Python + SQL
• Build and maintain the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using Python and SQL (Snowflake & SQL Server) in both on premise and cloud environments
• Manage and improve the user facing server infrastructure (web + api) including authorization and load balancing
• Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
• Build analytics tools that that provide actionable insights on both the user interactions and infrastructure loads

Technical Qualifications:

• Python expert, notably savvy with data science stack (Pandas, NumPy, SciPy)
• Relational SQL databases, Microsoft SQL Server and Postgres preferred
• Snowflake cloud database experience
• Pipeline and workflow management tools: Airflow, Luigi, etc.
• Experience with AWS cloud services: EC2, EMR, RDS, Redshift, Athena, SQS, etc.
• 2+ professional years’ experience with Masters or 3+ professional years with Bachelor’s degree in Computer Science, Statistics, Informatics, Information Systems or another quantitative field.

Highly Valued:

• Data Science/Analysis background
• Computer science understanding, data structures, processes, threading, memory usage
• Unix/Linux command-line experience
• Broad understanding of equities, derivatives, futures, FX, or other financial-services instruments

Other Qualifications:

• Excellent listening, and communication (both oral and written) skills
• Self-starter and critical thinker, takes ownership of own projects and makes improvement suggestions for the entire infrastructure.
• Proactive, assertive and attentive to details.
• Can work independently and in a collaborative environment.
• Can handle several projects with different priorities at the same time in a fast-paced environment.
• Excellent self-management and problem-solving skills.
• Results-oriented, can deliver quality code quickly