We are setting up a new data analytic environment.  The environment resides in a Amazon Web Services (AWS) private cloud.  At this stage our combined data is less than 500 GB and spread across a number CSV files.  The data represents ~8 domains. We need to load our data into a base set of tables, and then connect the data to Tableau where we can define relationships and produce an extract file for ongoing analysis. 

We would like to achieve the transformation and load over the next 2 days.  Today is 10/21/2014.

A Fortune 50 Financial Services firm is developing its future state Data Architecture - which will include Big Data technologies/components in conjunction with traditional data sources.  The Big Data Architect will be someone with strong Data Warehousing background and some exposure/experience with architecting Big Data solutions.  This person will be working closely with the other Data Architects who have domain knowledge and are familiar with legacy infrastructure - to understand the pain points and business drivers for Big Data then develop a reference architecture for a Big Data Lake, a strategy for sourcing data into the lake from various sources, developing a high level roadmap and strategy to get there.  Must have strong communication and interpersonal skills and be able to influence key stakeholders.

The client has several warehouses running in Netezza and Oracle environments.  Various consumers like Risk Management, Chief Economist, Modeling and Analytics, and Sales and Marketing would like to gain access to a compreshensive set of data across the information lifecyle - origination, underwriting, acquistiion, servicing, capital markets etc.

Responsibilities:

• Lead the architecture, design and development of the next generation Big data Business Intelligence and Data warehouse environment. Ensure that architecture supports both legacy and new capabilities.
• Developing analytical solutions to business problems through the design and programming of Business Intelligence/Data warehouse constructs and presentation layers.
• Develop data sourcing, data integration and data vending strategies and designs, after analyzing the design patterns.
• Collaborate with other Data Architects to understand the current state to develop the future state architecture, taking their input into account.
• Develop presentations to influence senior management - so that they understand the business value of Big Data and its architecture.  Work closely with hiring manager to educate staff and other managers on Big Data technologies.

Requirements:

• 6+  years Data warehouse/Business Intelligence experience with 1+ years handling big data platform using Hadoop technology
• Must contribute to overall team success; committed to building a strong team.
• Must be a self-motivated, energetic, detail oriented team player passionate about producing high quality BI & analytics deliverables and thrives in a collaborative environment.
• Excellent written and verbal communication skills
• Exceptional Data Warehousing and Modeling skills with proven track record designing large, complex Data Warehouse solutions integrated with Hadoop pulling from multiple data sources
• Extensive experience with and knowledge of multiple Data Warehouse/Data Mart architectures including Hadoop, various MPP and SMP database systems.
• Must have deep understanding and expertise in multiple ETL development tools like Informatica , DataStage, Talend, etc, Hadoop tools like Scoop and Flume and how to leverage for effective enterprise scale big data platform  implementation and management

The resource will need to spent time on-site in Washington DC a few days each week. The remaining work can be done virtually.  Candidates must be US-based with work authorization in the US. .

As an OpenStreetMap Developer, you will be part of a small, distributed team of scientists and engineers working on the cutting edge of consumer navigation, route planning and transportation science. The ideal candidate would have expertise working with converting OSM data to data structures used in route planning algorithms, real-time and historical traffic data integration route planning algorithms on large-scale road network data.

You will work with a team that is designing and building: (1) robust web services that deploy the most advanced route planning algorithms on the planet; (2) powerful mobile applications that create a compelling experience for consumers and businesses to steer clear of traffic, saving time and money and reducing congestion on our streets; and (3) innovative product features that change the way humans interact with their navigation tools. As an engineer on a small team, there is a tremendous opportunity to have a big impact.

Some of the technologies we use: Ruby, Rails, Scala, AWS, MongoDB, Jenkins, Chef, Git, iOS and Android developer platforms.

This is a virtual position.  Hourly Rate ranges from $100 to $150 per hour, depending on experience and expertise. We are looking for proposals that provide the best value.

We are building a web based SaaS application (LAMP framework) focused on helping sales and marketing better target and engage prospects.  The application is powered by a large database (currently mySQL), which is updated on a daily basis with new incoming data.  Due to the increasing size of our daily updates, our mySQL scalability will soon hit a wall and we need to redesign our system architecture.  

We're looking for someone to help us plan and design a new architecture for the next version of our POC application.  This project will likely have multiple phases, the first being the design of a general framework upon which we can continue development without concern of data scalability and that will accomodate future functionality powered by complex data science.  

The idea is to throw some data together and be able to produce dashboards that we can show our clients.

We are trying to move away from the current process where we download csv files from the same data providers, use Excel to create charts and then send via email.

The project entails the following:

• Integrate Tableau as the UI output app, now available on AWS
• Integrate third party APIs i.e. AHREFs, Google Analytics, Deepcrawl, ALABs, Alexa, Twitter
• Set up a database
• Create a front end to input a domain, and inputs with limits on what I want pulled from the APIs

This is the technology stack that we are looking at:

• S3
• AWS
• Integrating API apps
• MongoDB
• Some basic UI design
• Tableau (which is also an AWS app)

This is Phase 0.  Phase 1 and 2 are posted as seperate projects and will begin much later.  Phase 1 will add a Python crawler; and Phase 2 will add a data science module. Please only bid on Phase 0 since the future phases are dependent on this initial phase.

You will help us build a Big Data Analytic system designed and implemented on top of a cloud infrastructure service like AWS. The goal of this system is to crawl and extract information from websites, which is used to build predictive models. This project has two phases. In the first phase, you will integrate with third party APIs (e.g.: Alexa, Google Analytics) to accept a list of URLs that the system will crawl. You will parse the crawled content to extract HTML, CSS and images from the website. You will also build data store infrastructure in the cloud to store the extracted content. In the second phase, you will further process the extracted data to setup a feature engineering pipeline that will be used to build predictive modes. In this phase, you will look to construct progressively richer representations of the extracted data sets towards building increasingly sophisticated predictive models.

This request is for Phase 1 of the project which is application developement involving the following:

• User interfaces and web-app for interacting with user to capture input data and present results. (Front-end skills.)

• Scraping infrastructure and backend development using cloud infrastructure. (Backend skills.)

Scope of Work for Phase1

• Put together UIs to accept user provided data
• Put together UIs to present modeling output to user
• Scraping infrastructure built on a cloud IaaS to crawl user provided URLs
• Setup data store to preserve raw crawled content
• Extraction and storage of HTML content, Images etc from scraped output
• Setup data store to preserve data science work
• The system needs to minimise the the transfer of information between S3, EC2 and MongoDB to minimise computing

UPDATE: THIS PROJECT IS ON HOLD. PLEASE DO NOT SUBMIT BIDS UNTIL WE PROVIDE ANOTHER UPDATE TO MOVE FORWARD.

This is a data visualization project in which we would like to build a visually appealing "single webpage application" in HTML5 that would integrate seamlessly with JSON data. The platform is for financial clients. Technologies we would require the design to be completed in d3, SVG, CSS3. Very high emphasis on clean interface and single page application to display all relevant information.

Features:

• Equally sized rectangular cell HeatMap with colors gradient based on specific range of numbers
• Ability to hover over information for each cell on the HeatMap
• Ability to filter the HeatMap
• Ability to group the HeatMap based on specific fields
• Ability to sort the HeatMap
• Ability to open a model window at the bottom of the screen that displays analytical computations

The attached document provides additional details with a rough wireframe.

Process:

• If necessary, we can provide the developer with a design mockup for the visualization
• The developer will translate the mockup exactly into HTML5/CSS
• The developer will visualize the data-set we provide using D3.JS and SVG

Proposal:

Please break this project into 2-3 milestones and tell us how long each phase will take.  Please also provide examples of similar work you have done. If you have design background and can help will the design mockup as well, please let us know.

You will help us build a Big Data Analytic system designed and implemented on top of a cloud infrastructure service like AWS. The goal of this system is to crawl and extract information from websites, which is used to build predictive models. This project has two phases. In the first phase, you will integrate with third party APIs (e.g.: Alexa, Google Analytics) to accept a list of URLs that the system will crawl. You will parse the crawled content to extract HTML, CSS and images from the website. You will also build data store infrastructure in the cloud to store the extracted content. In the second phase, you will further process the extracted data to setup a feature engineering pipeline that will be used to build predictive models. In this phase, you will look to construct progressively richer representations of the extracted data sets towards building increasingly sophisticated predictive models.

This request is for the second phase of the project which includes:

• Feature extraction from crawled content
• Data science modeling
• The system needs to minimise the the transfer of information between S3, EC2 and MongoDB to minimise computing costs
• Link classification algorithm
• D3 Visualisation

We are looking for someone to make some updates to our Commissions Database. This is a web based application that was built using PHP. We use this tool each month to calculate what we owe our Agents / Sales Reps in commission on the deals they board with us. A report has to be generated for each deal or merchant loaded in our system. This is mostly a manual process today. At the end of running and saving each individual report, we generate Commission Statements for each Agent / Sales Rep. Today, when I download the PDF Commission Statements from our system, I am required to download each one individually. Instead, I would like to be able to download them all at the same time in one batch as a zip file. If you are interested, please contact me and I can run you through a demo of our system. This is a project that we would be looking to launch in Q1 of 2015.

We are interested in working with someone to build a tool that will help us automate our Pre App review process. Please see the attached Power Point presentation for further details on the project. This is a project that we would be looking to launch in Q2 of 2015.