Aug 30, 2022
No image
Service categories
Service Lines
Software Development
Domain focus
Technology
Programming language
C/C++
Frameworks
Node.js
Challenge
The biggest challenge to overcome was to scale the code analysis system to the extent that any of the job systems can take and process parallelly without degrading the overall performance. With scaling, we also face the challenge of sharing the same filesystem across multiple running instances.
Another challenge was to integrate with GitHub to track every commit and pull request in real-time and update the status checks for the same.
The biggest challenge to overcome was to scale the code analysis system to the extent that any of the job systems can take and process parallelly without degrading the overall performance. With scaling, we also face the challenge of sharing the same filesystem across multiple running instances.
Another challenge was to integrate with GitHub to track every commit and pull request in real-time and update the status checks for the same.
Solution
After multiple trials and errors, we developed a watchdog service which monitors available jobs in the queue at a 1-minute granularity level and deploy analysis instances in an autoscaling manner.
For distributed file systems the static analysis code tool leverages the AWS EFS file system to solve the issue of attaching the same filesystem to multiple instances. For real-time events from Github, we took webhook into consideration and deploy the fault-tolerant webhook service to provide useful updates on commits and pull requests.
After multiple trials and errors, we developed a watchdog service which monitors available jobs in the queue at a 1-minute granularity level and deploy analysis instances in an autoscaling manner.
For distributed file systems the static analysis code tool leverages the AWS EFS file system to solve the issue of attaching the same filesystem to multiple instances. For real-time events from Github, we took webhook into consideration and deploy the fault-tolerant webhook service to provide useful updates on commits and pull requests.
Results
After multiple trials and errors, we developed a watchdog service which monitors available jobs in the queue at a 1-minute granularity level and deploy analysis instances in an autoscaling manner.
For distributed file systems the static analysis code tool, leverages the AWS EFS file system to solve the issue of attaching the same filesystem to multiple instances. For real-time events from Github, we took webhook into consideration and deploy the fault-tolerant webhook service to provide useful updates on commits and pull requests.
After multiple trials and errors, we developed a watchdog service which monitors available jobs in the queue at a 1-minute granularity level and deploy analysis instances in an autoscaling manner.
For distributed file systems the static analysis code tool, leverages the AWS EFS file system to solve the issue of attaching the same filesystem to multiple instances. For real-time events from Github, we took webhook into consideration and deploy the fault-tolerant webhook service to provide useful updates on commits and pull requests.
No image
No image
