Crawler Lib Company Presentation

Bright solutions for application and service back-ends.
A Presentation of Our Company
Copyright © 2015 Crawler-Lib. All rights reserved

Content
1. About Crawler-Lib
2. Our Services
3. Our Products
3.1 Crawler-Lib Engine
3.2 Crawler-Lib Services
3.3 Crawler-Lib Storage Operation Processor
4. Our Skills & Tool Set

5. Contact
Appendix A: Links
Appendix B: Free and Open Source
Page 2 | Company Presentation Crawler-Lib | 18.03.2015 Copyright © 2015 Crawler-Lib. All rights reserved
1. About Crawler-Lib
 Crawler-Lib is a startup founded in 2014 as a spin-off of a company producing

software for travel agencies.
 Much knowledge about massive data processing, web frontends and distributed
computing was gained in a big project starting in 1999 for a travel agency franchise
company. This project - financed by Germany’s biggest tour operator TUI AG - is
written in C++ and uses the Microsoft SQL Server as database.
 Based on these skills and experiences smaller data mining and information retrieval
solutions were written - mainly in C# / .NET. Since similar structures and problems
occurred in those back-ends, we started programming a .NET back-end framework.
 During the development of this back-end framework we came across any problem
with multi-threading, synchronization, performance bottlenecks, distributed computing,
hosting, etc and elaborated special build processes and tools, agile methods and
skills. The development of our website and licensing system, some open source
software and our components on NuGet complete our package.
 Crawler-Lib has new and efficient solutions. We can boost even projects that already
stuck in performance issues, multi-threading and distributed computing problems.
Give us a try, you won’t regret!
2. Our Services
 Consulting
We advise and support you regarding the architecture of your application
backend - and help you to find a maintainable and performant design.
 Performance Tuning
We optimize the multithreading performance and throughput of your application or
service and find bottlenecks in code and design.
 General Development
If you need additional manpower for your projects. We are very flexible. We can
work with your team in-house or as teleworkers or we can do sub-projects or
complete projects for you.
3. Our Products
 Back-End Development Framework

We provide an application and service backend framework for Microsoft .NET
and Mono to standardize and boost the backend development.
Background Task Processing
Backend Hosting Infrastructure
Storage Operation Processing
3.1 Crawler-Lib Engine
 Background Task Processing

The Crawler-Lib Engine is a component to simplify and standardize the processing
of background tasks. It is the central point for any task that should be performed in
the background on multiple threads with high throughput and performance.
 General Purpose Workflow Processor

The Engine allows the design of arbitrary background tasks with highly configurable
workflows which are executed in parallel on multiple threads. Various workflow
control elements like ‘Group’, ‘Retry’, ‘Cost’, ‘Limit’ and ‘Calculate’ allow to define
complex workflows without worrying about synchronization issues or API limits.
 Open Architecture
The Crawler-Lib Engine can be extended in several ways. Most important: it allows
the creation of new workflow elements to support any kind of API or technology.
 REST/OpenAuth APIs like Facebook, Google and Twitter
 SOA / WCF based APIs
 File / Database / Data Mining Operations
 etc
3.2 Crawler-Lib Services
 Windows Service and Linux Daemon Development

The Crawler-Lib Services provide a foundation for platform independent services
that can be run on Windows, Linux, OSX and in the Cloud. It can also be used to
integrate a backend in an application as an isolated component.
 Component based Service Architecture

The Service itself can be designed as independent components and organized in
modules. The wiring of the components is made with an IoC container. That allows
the typical frontend patterns to be used to create a non-monolithic backend.
 Flexible Hosting
In contrast to SaaS or BaaS the Crawler-Lib Services is a framework part and not a
hosting provider. The finished back-end can be hosted on your own hardware or a
cloud provider of your choice. And the backend can be hosted even in an
interactive application itself.
3.3 Storage Operation Processor
 Optimizing Storage Operations

The Storage Operation Processor boots the performance of database and file
operations. It can be used to make the frontend more responsive and to boost the
throughput of operations. It is designed for multithreaded operations as in back-
ends for web servers, data warehouse, SoA, etc
 Batching
Modern back-ends have to deal with thousands of requests that perform very small
(often read) operations. The Processor combines multiple requests and batches
them to the database as one operation. This increases the throughput by factors.
 Priorities and Responsiveness

The incoming requests have a priority assigned. The frontend requests can have a
higher priority. That keeps the frontend responsive even when background tasks
perform heavy load on the storage.
 Locking
Transactional write operations can’t sometimes be batched, where read operations
often can. The Processor implements grouping and isolation options that can be
used as a reader/writer lock.
4. Our Skills & Tool Set
Languages and Platforms Application Lifecycle Management

 C#, C++  Hudson/Jenkins
 .NET Framework  Team Foundation Server
 Mono / .NET Core  NUnit
 HTML / ASP.NET / MVC  MS Test
 PowerShell  SVN / Git / Mercurial
 XML/XLST  Powershell Build Tools (Crawler-Lib)
 WCF, REST, ...
Databases / Mappers IDE / Tools

 MS SQL Server  MSDN Ultimate
 PostgreSQL  Visual Studio Ultimate 2013
 MySQL  JetBrains Resharper Platform
 MongoDB ReSharper, dotCover, dotMemory,
 Hadoop dotTrace
 DataObjects.NET  Sandcastle Help File Builder
 NHibernate  VSDocMan
 EntityFramework  Help & Manual
5. Contact
We are looking forward to getting in touch with you!
Crawler-Lib HQ, Sales & Support: Crawler-Lib Development & Consulting:
Walter Zirn Thomas Maierhofer

Brückenstraße 1 Phone: +49 731 / 725 6728
89231 Neu-Ulm Mobile: +49 152 3353 9822
Phone: +49 731 / 725 6728 Home Office: +49 7504 970 9184
Mail: info@crawler-lib.net Mail: tmaierhofer@crawler-lib.net
VAT-ID: DE185609315
Homepage: http://www.crawler-lib.net/
Appendix A: Links
Crawler-Lib Sites
 Homepage: http://www.crawler-Lib.net
 Blog: http://www.crawler-lib.net/blog
 Downloads: http://download.crawler-lib.net/
 Help & Reference: http://help.crawler-lib.net/
 Twitter: https://twitter.com/CrawlerLib
 YouTube: http://www.youtube.com/user/CrawlerLib
 Google+: https://plus.google.com/102488069995729942110/posts
 NuGet Gallery: https://www.nuget.org/profiles/crawler-lib/
Crawler-Lib Development and Consulting Service

 http://www.crawler-lib.net/development-consulting-service
Crawler-Lib Framework
 Tasks: http://www.crawler-lib.net/framework-background-task-processing
 Services: http://www.crawler-lib.net/framework-back-end-service-components
 Storage: http://www.crawler-lib.net/framework-storage-operation-processing
Appendix B: Free and Open Source
Crawler-Lib Libraries for .NET
 Child Processes – Child Process Management
http://www.crawler-lib.net/child-processes
 Concurrency Testing Helper – Multiple Threads in Unit Tests / Integration Tests
http://www.crawler-lib.net/crawler-lib-concurrency-testing
 NHunspell – Open Office Spell-Checker Wrapper
http://www.crawler-lib.net/nhunspell
Build Process
 Crawler-Lib Build Tools – PowerShell based Build Automation Toolbox
http://www.crawler-lib.net/build-tools

Crawler Lib Company Presentation

Caricato da

Informazioni sul documento

Copyright

Formati disponibili

Condividi questo documento

Condividi o incorpora il documento

Opzioni di condivisione

Hai trovato utile questo documento?

Questo contenuto è inappropriato?

Copyright:

Formati disponibili

Crawler Lib Company Presentation

Caricato da

Copyright:

Formati disponibili

Bright solutions for application and service back-ends.

A Presentation of Our Company

Copyright © 2015 Crawler-Lib. All rights reserved

4. Our Skills & Tool Set

 Crawler-Lib is a startup founded in 2014 as a spin-off of a company producing

 Back-End Development Framework

Background Task Processing

Backend Hosting Infrastructure

Storage Operation Processing

 Background Task Processing

 General Purpose Workflow Processor

 Windows Service and Linux Daemon Development

 Component based Service Architecture

 Optimizing Storage Operations

 Priorities and Responsiveness

Languages and Platforms Application Lifecycle Management

Databases / Mappers IDE / Tools

We are looking forward to getting in touch with you!

Crawler-Lib HQ, Sales & Support: Crawler-Lib Development & Consulting:

Walter Zirn Thomas Maierhofer

Crawler-Lib Development and Consulting Service

Potrebbero piacerti anche