Product Engineering Engagement – Log Management Platform Development & Integration with Jira, Slack, GithHub

Client:
Based in San Francisco, our client was a leading cloud-based log management and analytics service provider.

Business Requirement:
Client wanted to build a web-based enterprise log management platform which would allow:

  • Capture & records log data across devices leveraging open-source technology
  • Rich & in-depth real-time reports with trend data helping technical operations, development, customer service, & product management teams

Engagement Scope:

  • Core platform & functionality development
  • Executive dashboard & business driven reporting showing various charts
  • Build seamless integration between log management platform with Atlassian JIRA Software Cloud using its REST API’s that improve collaboration between product and operations team members
    • Used AngularJS & Django framework to develop features such as:
      • create and update JIRA issue directly from log management platform with the required event information
      • add event details to an existing issue
      • add comment to an existing issue for notifying team members
      • add labels to an existing issue for easy access in JIRA Dashboards & Reports
      • create templates to pre-populate the issue fields at the time of creating an issue & speed up the process of creating issues
  • Build seamless integration between log management platform with GitHub using its REST API’s that improve collaboration between DevOps team members
    • Used AngularJS and Django framework to develop features such as
      • create and update issue directly in GitHub with the required event information & event permalinks
      • add event details & relevant log analyses to an existing issue & share with the development team
      • add comment to an existing issue for notifying team members
      • view the code commit history of the relevant source code file
  • Build seamless integration between log management platform with Slack through incoming Webhook API which use HTTP requests with JSON payload
    • Used AngularJS and Django framework to develop features such as
      • ability to configure Salesforce Slack endpoint into the log management platform & authenticate using WebHook URL
      • select existing channel or create new channel to post messages using incoming WebHook (Alerts)
      • sends alerts to Slack rooms to notify room members to get quick attention
      • configure alerts based on user defined criteria in Log management platform to send alerts on Slack

Benefits:

  • Automation for JIRA ticket creation based on log event details & also avoid duplicate JIRA ticket
  • Improved analytics by adding relevant log analyses to the existing issues
  • Avoid context switching or copy-and-paste by adding labels, comments to the existing issues directly from log management platform UI
  • Improved collaboration between DevOps team through introducing best practices & making code more production-friendly
  • For any log event, the operations users can view all recent commits on those source code files matched with the exception and see which recent transaction may have caused the issue within Log management platform UI itself without going over to GitHub. This visibility streamlines troubleshooting operations & enables better auditing of regressions
  • Improved collaboration between DevOps team with real time notification on slack channel to resolve the issue quickly
  • User defined filter criteria to receive Slack channel notification to improve response time

Technology Stack:

  • Development Stack: AngularJS, Django framework, MySQL, Bootstrap
  • Test frameworks:  Protractor with Jasmine, Mocha & Chai
  • Development & Support Tools: GitHub, Jira, Visual Studio Code