Summer means vacations and pool time, but we haven't stopped working on Exceptionless 2.0. Things are coming along nicely, and today we're here to talk about the job system and the code being written to enhance it.
After you read this article, check out the previous V2.0 feature and detail articles, if you haven't already. Good stuff in there!
Jobs can easily be run standalone now, which makes it much easier to test the system. You won't have to worry about your application pool shutting down prematurely and killing your job half way through it's long-running work item.
We've thrown out a lot of information about Exceptionless 2.0 and all the new features, enhancements, and tweaks that it's going to get. We'd love to hear from some of the regulars out there and see if we've missed anything obvious. Check out the links to the other articles at the top of the page and let us know. Thanks!
In an effort to improve scalability, allow for new functionality to easily be added to Exceptionless, make the system less coupled, process things more efficiently, go fully Async, and further support Azure, we've been working hard on a new message bus and queueing system.
Lets take a look at a few of the details surrounding these new systems we're building for Exceptionless 2.0. Take a look and let us know what you think. If you've got questions or comments, we'd love to hear them!
The new queueing system allows us to enqueue expensive tasks that can be handled at a later time. This lets us greatly reduce the processing and latency times of the api.
We stream event data that is posted to the event controller directly into the queue without taking the IO or Memory hit of processing it. This means that we can process more errors, faster, with less resources.
The system also supports retrying and discarding of data.
We queue emails that need to be sent, as well as user defined webhooks that need to be called with data. Email servers on the sending and receiving can go offline or error out while sending, but by queuing the notification emails we can ensure you always get them by re-sending in the future, after a failure occurs. In the event that we can't send you an email after a few retries, we can discard the notification.
As Exceptionless 2.0 continues to become a reality, we thought we would give everyone a little taste of what you will be able to do with the new, rewritten client. Continue reading for a glimpse at the primary features, along with a complete usage example for adding extra data to events.
After you check it out, let us know if you have questions or suggestions. We're listening!
In the last Exceptionless 2.0 article, we announced the upcoming simplified API. Today, we want to introduce another major piece of V2.0 - the pluggable system.
Plugins will allow customization and translation throughout the Exceptionless platform, including integration with third-party services and more. Read on for more details about pluggable details such as event parsing, event pipeline, and formatting.
We're anxious to get Exceptionless 2.0 wrapped up, but we do not have an ETA currently. We are working hard and making good progress, so keep an eye out for more sneak peeks, feature announcements, and progress reports!
As always, please let us know if you have any feedback or questions.
Since going open source, we've wanted to simplify the API and make it easier to work with.
We're taking the time to do it now, and it's going to be awesome!
Exceptionless 2.0, coming soon, will have a new, manageable API with tons of great documentation and examples. Take a look at the preliminary documentation at the below link, and make sure to give us any feedback you might have.
Event POSTs take the raw data and use a plugin system to interpret that data and translate them into events.
This allows us to take literally any data and turn it into events in the system.
The POST data is captured as a raw bytes and added immediately added to a queue for processing.
Plugins can easily be created to support new data formats like system logs.
This simplified API will make creating libraries for other platforms dead simple.
The API lives in a separate project and can be hosted on high-performance systems like the new Helios IIS host.
Makes it easy for us to migrate the UI to a SPA app.
Now uses OAuth 2.0 in addition to supporting API tokens.
Highly consistent REST API modeled after GitHub and Stripe.
It's so simple you can just use CURL as a client.
We hope you're as excited as we are to have this new, improved, more complete, and more usable documentation. Stay tuned for more details on the upcoming Exceptionless 2.0, and don't forget to leave a comment letting us know what you think.
While we're on the march to Exceptionless 2.0, we're still making updates and fixing bugs on version 1. Today, we'd like to announce that Exceptionless 1.5 has been released, which includes several server changes and bug fixes, as well as major client code base optimization.
Please update your client to version 1.5 and take a look at the other changes and bug fixes, below. We've done quite a bit of work to notifications, added throttling to improve coverage on small and free plans, and improved performance in a few places.
Added throttling to accounts that are over their usage limits. If an account is sending a high number of errors, the errors will be throttled on an hourly basis so that the entire plan limit won’t be used up immediately. This allows for a distributed sampling of the errors instead of only capturing everything in a short period of time.
Added a site notification that shows you when error submissions are being throttled or if you are over your monthly plan limits.
Removed total count from most recent errors list as it was a very expensive to calculate while providing little value.
Fixed a bug with notifications that could cause some users to get spammed. Now notifications only send a maximum of 10 notifications per project every 30 minutes.
Greatly simplified the authentication logic for the web api pipeline.
Added the ability to print all content on the error occurrence page.
The pager will no longer scroll to the top of the current list when changing pages.
Updated the paged lists to only refresh the list data via push notifications when you are on the first page.
The list data will only be updated in real time if the data matches the current filter criteria.
Fixed a bug where the loading indicators would appear on the suspended and manage organization pages.
Fixed a bug where the save button on the manage organization page would have improper styling.
Fixed a bug where a HttpAntiForgeryException could be thrown when accessing the website.
Fixed a bug where a ArgumentException would be thrown if multiple model validation errors occurred on a single page.
Fixed a bug where a NullReferenceException could be thrown when signing up.
Added some additional checks to try and resolve the user profile when an invited user signs up.
Fixed a bug where an updated organization notification could be sent before the user was authorized to access the organization.
Fixed a bug where empty OS Name and Version values were being shown in the errors environment section even if they didn't exist. This could happen if the client was reporting from an azure website instance.
Changed billing plans to use per month error limits.
Fixed a bug where the BillingManager could throw a NullReferenceException for a newly added organization. This could happen because the primary node had not replicated the content to the secondary nodes or the data wasn't cached on creation.
Updated various MongoDB collections to not persist empty array fields.
Fixed a bug where some cache entries were not automatically expiring.
We hinted that more details on the upcoming Exceptionless 2.0 release would get announced soon, and here we are! Lets dive in a bit further, shall we?
Many users have asked for ways to use Exceptionless to report additional types of events, rather than just errors. With version 2.0, we are moving to an event based system that will accommodate such requests.
What's an Event Based Real-Time Reporting Tool Look Like? #
The new system allows us to receive literally any data people want to send us instead of only allowing errors.
Event posts can be as simple as this:
You can send log messages or even entire log files.
Log messages can contain extended data objects just like errors can now.
You can post random JSON objects and the data within them will be treated as extended data.
You can post batches of events instead of only being able to send one at a time.
You can send feature usage events that let you see how often features of your application are being used. Think about how useful that will be!
You can send session start and end events that will enable you to know what percentage of users are affected by errors and enable you to better know what your priorities should be.
We will be gathering enough data to make it easy for us to begin putting together some very useful analytic reports.
We're pretty excited about the switch from error-only to send-us-any-event-you-can-think-of real-time reporting, logging, and notifications. We think it's going to be awesome, and it's almost scary how much of a playground Exceptionless is going to turn into for some of our customers. We're not pushing the limits, we're pushing for no limits!
Ideas? Concerns? Let us know. We're working hard to wrap up Exceptionless 2.0, but there's still a lot more bells and whistles we're polishing before launch! Keep an eye out for still more sneak peek material in the coming weeks!
It may seem quiet in Exceptionless land, but the truth is we've been writing, and re-writing, more code than you can point a cursor at. If it weren't a labor of love, our fingers would have mutinied long ago, but luckily they are in it for the long haul and are churning out some seriously sweet new features and rewrites.
Exceptionless 2.0 will include many of the feature requests that have come in since we launched, and will drastically expand on the current functionality. We know you'll love it, so continue reading for a high level view of what's coming in the near future.
All we're trying to point out is that when you start tracking and organizing the errors in your code, inevitably you'll start to realize that a small percentage of bugs are causing the majority of your total errors.
We realized this ourselves, so we built the "Most Frequent Errors" report right into the Exceptionless dashboard.
When you log into your account, you immediately see which errors are causing the largest number of exceptions, how many instances of each there is, when the first occurrence was, and when the last occurrence was.
From there, you can click in, view there error's details, and hopefully find a quick resolution to the problem.
While it's great to chip away at the most frequent errors, it's worth pointing out that most frequent doesn't always mean most important, so be sure to focus on bottom line, customer facing, and major functionality issues first!
In your coding adventures, have you found the 80-20 rule to apply to your exceptions? Was it something you found quickly, or did you track down numerous instances of the same error before realizing it?
We like to know how Exceptionless is helping its users, and we love it when we get feedback! Every once in a while, we like to share a story or two so we can drive home the benefits of having a real-time exception logging service tied into code projects.
Surveys are sometimes sent out to users, and we wanted to share a few recent responses.
What is the number one customer-facing bug that Exceptionless has helped you track down? Can you give us a brief description of the bug and how you solved it?
User 1: "Missing DLLs in the client environment, due to required 3rd party apps not being installed (eg: Crystal Reports runtime). [Exceptionless] enabled me to create a list of missing DLLs and computers for relay to the client."
User 2: They were previously handling their own exception logging well and don't have any serious customer-facing errors coming in.
When you first started using Exceptionless, were you surprised by the number of errors that were being reported? Approximately how many were you seeing per day?
User 1: "Not really, but just because I had written a similar tool that logged these before, they just were not as accessible (database table on web service)." The user reported that the above bug was appearing 10-15 times each day.
User 2: They were already handling their error logging and already had errors down to a minimum, around 50 per month. "The primary reasons that we switched to Exceptionless from our own code is that Exceptionless captures additional detail (including code line numbers), Exceptionless has a better interface and design for reviewing and managing errors and bugs (including summary views that we didn’t previously have), and we no longer need to maintain our own error-logging code."
What is the number one internal bug that Exceptionless has helped you track down? Can you give us a brief description of the bug and how you solved it?
User 1: N/A
User 2: "...a small number of situations where our code doesn’t correctly handle empty record sets (that is, where, based on the specific query string parameters in the URL, no corresponding records are found in the database and the page is expecting that there will always be records to display)."
What is the number one feature request or change that you would like to see the Exceptionless Team tackle?
User 1: "More options to filter dashboard by tags/versions/environment variables. Custom reporting, exporting to CSV file etc or other way to import them into TFS or similar."
User 2: "...my number one request is probably for additional information in daily summary emails and for a combined daily summary. Notification defaults and moving notification settings out of the project setup is probably a close second; or perhaps the ability to add comments when marking an issue as fixed would be my second highest feature request."
If you have any other other examples of Exceptionless helping you squash bugs, please share them below - we would love to hear them!
User 1: N/A
User 2: "...in our small team, the additional information from Exceptionless (as well as the process of converting to Exceptionless) has prompted us to review and solve a few ongoing bugs that we were aware of..."
If you use Exceptionless to log, report, organize, and squash errors in your code, we want to hear how it helps, what kind of crazy errors you are eliminating, and your general thoughts on the project! Don't be shy, we won't bite.