Databricks Data Engineer

<h2 style="text-align: center;">&nbsp;</h2> <h1 style="text-align: center;">Databricks Data Engineer</h1> <h2>Who we are</h2> <p>Horizon Industries Limited (Horizon) is a dynamic IT and Management Consulting firm based in the Washington, DC area. Founded in 1996, Horizon Industries Limited (Horizon) has evolved into a company of highly qualified professionals that provides full-cycle IT Consultant and Management support in both the private and public sectors.</p> <p>Horizon’s culture is based on our core values, and we PRIDE ourselves on a diverse, employee, and family-centric approach.</p> <p><strong>&nbsp;</strong></p> <h2><strong>Who we are looking for</strong></h2> <p>We are seeking a Databricks Data Engineer for a full-time position supporting our various clients</p> <p>We are committed to your growth and success in the IT software development industry. We are looking for a Databricks Data Engineer ready to assume leadership responsibilities in a supportive team environment focused on your success as a function of client success.</p> <h2><strong>&nbsp;</strong></h2> <h2>What your day-to-day will look like / Responsibilities:</h2> <ul> <li>Build end-to-end implementation of multiple ETL/ELT pipelines, demonstrating efficient data transformation and ingest patterns to move raw data from data producers to an enterprise data ecosystem, with a focus on performance and reliability</li> <li>Assess and understand the ETL jobs, workflows, BI tools, and reports</li> <li>Address technical inquiries concerning customization, integration, enterprise architecture and general feature / functionality of data products</li> <li>Experience in crafting database / data warehouse solutions in the cloud (Preferably AWS, Azure, Alternatively GCP)</li> <li>Key must have skill sets – Python, SQL, Databricks, AWS Data Services</li> <li>Experience with message queuing, stream processing, and highly scalable ‘big data’ data stores</li> <li>Experience manipulating, processing, and extracting value from large, disconnected datasets</li> <li>Experience manipulating structured and unstructured data for analysis</li> <li>Experience with data modeling tools and processes</li> <li>Experience aggregating and transforming data from multiple datasets to create data products</li> <li>Support an Agile software development lifecycle</li> </ul> <h2>What we would like to see on your resume/ Required Skills</h2> <ul> <li>Ability to hold a position of public trust with the US government.</li> <li>S. in Computer Science or equivalent</li> <li>4+ years' experience in data engineering and big data. At least 2 years' of professional services experience interacting directly with clients. <ul> <li>Big data tools: Hadoop, Spark, Kafka, etc.</li> <li>Relational SQL and NoSQL databases and experience working with relational databases</li> <li>AWS cloud services: EC2, S3, RDS, Glue, Step Functions, Lamda, EMR, DynamoDB, DocumentDB, Redshift, Aurora, Athena</li> <li>Data Platforms: Databricks</li> <li>Data streaming systems: Batch,Kafka, Storm, Spark-Streaming, etc.</li> <li>Languages: Python, R, Scala, Go</li> </ul> </li> <li>Ability to inspect existing data pipelines, discern their purpose and functionality, and re-implement them efficiently in Databricks.</li> <li>Extensive knowledge of data warehousing concepts and hands-on experience deploying pipelines using Databricks **a must</li> <li>Data modeling and database design skills and knowledge of version control</li> <li>Excellent verbal and written communication skills</li> <li>Experience architecting scalable and fault-tolerant data solutions across Azure, AWS, and Databricks</li> <li>Databricks Data Engineer Professional certification a plus.</li> <li>Preference for candidates with Databricks Professional certifications</li> </ul> <h2><strong>What specifically does this role require</strong></h2> <p><strong>Education:</strong>&nbsp;&nbsp;Bachelor’s degree in a technical field such as software engineering, engineering, computer science, etc.</p> <p><strong>Location</strong>&nbsp;: Horizon is headquartered in the heart of Tyson’s Corner, VA. Occasional travel may be required.</p> <p>&nbsp;</p> <h2>Why you will love working with us/ Perks</h2> <ul> <li>A comprehensive benefits package including healthcare (medical, dental, vision and disability)</li> <li>a 401k program where you are 100% vested from day one with an employer match after 90 days.</li> <li>an Educational Assistance program.</li> <li>a Student Loan Repayment Program</li> <li>Gym Reimbursement Program.</li> <li>Paid Time off</li> <li>Dynamics, passionate, multi-disciplinary team of creative minds to work with, and many more.</li> </ul> <p>&nbsp;</p> <p>Horizon is an Equal Employment Opportunity employer, and it is our policy to consider all&nbsp;applicants for employment. All qualified applicants will receive consideration for employment&nbsp;without regard to race, color, religion, sex, sexual orientation, gender identity, or national&nbsp;origin. &nbsp;</p> <p>&nbsp;</p> <p style="text-align: center;"><strong>EOE/Vet/Disabled</strong></p> <p>&nbsp;</p> <p>&nbsp;</p> <p>&nbsp;</p>