XCMetrics is the easiest way to collect Xcode build metrics and improve developer productivity.

Hey,

The following PR would be addressing the ability to compile the backend with Xcode 14, as mentioned in the following issue https://github.com/spotify/XCMetrics/issues/85.

Hi!

I would love the ability to know if a build is associated with a specific git branch, as this would help me analyze improvements or regressions in build times which may be coming in on new PRs. Happy to propose an implementation if this is a welcomed addition.

Thanks!

Hello,

When querying XCMetrics for the main target app build time I have also the build time for the RichNotificationExtension. When doing median calculation it makes the results flaky as the extension takes a lot less time to build.

Is there a way to differentiate those two? Do you have suggestion on how to workaround that issue?

On our CI we are using a cloud based provider and it seems that the machine name is changing for each pipeline, so by aggregating first by machine name I get coherent results. But this solution won't work for local developer machines. Furthermore, as we are monitoring success builds for the same build I can have the main app succeeding but the extension failing and it will not be a failed build.

Thank you very much

I am trying get values from DailyStatisticsJob at /v1/statistics/build/count?days=14 but the statistics_day_build_time table is empty. And while debugging the XCMetricsBackendLib/Config/configure.swift there isn't a call to startScheduledJobs() or similar across the project.

I am missing where it is being called? Or there is other way to start the scheduled jobs?

When attempting to upload an XCActivityLog that is rather large (29.1 MB) with many targets, and many steps, XCMetrics logs an error: [ ERROR ] Uncaught error: NIOPostgres error: protocol error: Bind count must be <= 32767.

A Google search for that error pointed me to: https://github.com/vapor/fluent-kit/issues/277. It seems to be related to the number of parameters that are being bound to a given query.

Here is what the breakpoint looks like after the log is parsed in the insert method of the PostgreSQLMetricsRepository struct.

Here is the raw log output:

[ INFO ] PUT /v1/metrics [request-id: 8C8BB0F4-A820-4661-9CD9-30CEE2C6A0B0]
[ INFO ] Dispatched queue job [job_id: 9170D075-D21B-4204-9E87-7D693A934C7B, job_name: ProcessMetricsJob, queue: default, request-id: 8C8BB0F4-A820-4661-9CD9-30CEE2C6A0B0]
[ INFO ] PUT /v1/metrics [request-id: F0778FB1-7894-46C8-A053-6F236902A751]
[ INFO ] Dispatched queue job [job_id: 5995640B-3785-48A5-B4BD-08593C61822A, job_name: ProcessMetricsJob, queue: default, request-id: F0778FB1-7894-46C8-A053-6F236902A751]
[ INFO ] Dequeing job [job_id: 9170D075-D21B-4204-9E87-7D693A934C7B, job_name: ProcessMetricsJob, queue: default]
[ NOTICE ] 17/02/2021 23:24:35 [ProcessMetricsJob] message dequeued [job_id: 9170D075-D21B-4204-9E87-7D693A934C7B]
[ NOTICE ] 17/02/2021 23:24:35 [ProcessMetricsJob] fetching log from file:///var/folders/rm/0tz8w5hx4kb597326bxp7ksh0000gn/T/5A1D12F4-5F8F-4ECB-8225-E38746464152/2C2594C3-4B6C-4F07-9145-461019452E4C.xcactivitylog [job_id: 9170D075-D21B-4204-9E87-7D693A934C7B]
[ NOTICE ] 17/02/2021 23:24:35 [ProcessMetricsJob] log fetched to file:///var/folders/rm/0tz8w5hx4kb597326bxp7ksh0000gn/T/5A1D12F4-5F8F-4ECB-8225-E38746464152/2C2594C3-4B6C-4F07-9145-461019452E4C.xcactivitylog [job_id: 9170D075-D21B-4204-9E87-7D693A934C7B]
[ INFO ] Dequeing job [job_id: 5995640B-3785-48A5-B4BD-08593C61822A, job_name: ProcessMetricsJob, queue: default]
[ NOTICE ] 17/02/2021 23:24:35 [ProcessMetricsJob] message dequeued [job_id: 5995640B-3785-48A5-B4BD-08593C61822A]
[ NOTICE ] 17/02/2021 23:29:11 [ProcessMetricsJob] log parsed file:///var/folders/rm/0tz8w5hx4kb597326bxp7ksh0000gn/T/5A1D12F4-5F8F-4ECB-8225-E38746464152/2C2594C3-4B6C-4F07-9145-461019452E4C.xcactivitylog [job_id: 9170D075-D21B-4204-9E87-7D693A934C7B]
[ NOTICE ] 17/02/2021 23:29:11 [ProcessMetricsJob] fetching log from file:///var/folders/rm/0tz8w5hx4kb597326bxp7ksh0000gn/T/276EEDC9-A774-408C-B14E-9C04124D377C/5100D986-E078-4BD8-A894-9163DD594967.xcactivitylog [job_id: 5995640B-3785-48A5-B4BD-08593C61822A]
[ NOTICE ] 17/02/2021 23:29:11 [ProcessMetricsJob] log fetched to file:///var/folders/rm/0tz8w5hx4kb597326bxp7ksh0000gn/T/276EEDC9-A774-408C-B14E-9C04124D377C/5100D986-E078-4BD8-A894-9163DD594967.xcactivitylog [job_id: 5995640B-3785-48A5-B4BD-08593C61822A]
[ NOTICE ] 17/02/2021 23:29:11 [PostgressMetricsRepository] creating daily partitions
[ NOTICE ] 17/02/2021 23:29:11 [ProcessMetricsJob] log parsed file:///var/folders/rm/0tz8w5hx4kb597326bxp7ksh0000gn/T/276EEDC9-A774-408C-B14E-9C04124D377C/5100D986-E078-4BD8-A894-9163DD594967.xcactivitylog [job_id: 5995640B-3785-48A5-B4BD-08593C61822A]
[ NOTICE ] 17/02/2021 23:29:11 [PostgressMetricsRepository] creating daily partitions
[ NOTICE ] 17/02/2021 23:29:11 [PostgressMetricsRepository] creating daily partitions
[ NOTICE ] 17/02/2021 23:29:11 [PostgressMetricsRepository] creating daily partitions
[ ERROR ] Uncaught error: NIOPostgres error: protocol error: Bind count must be <= 32767.
[ NOTICE ] 17/02/2021 23:29:16 [PostgressMetricsRepository] metrics inserted
[ INFO ] [ProcessMetricsJob] metrics inserted for file:///var/folders/rm/0tz8w5hx4kb597326bxp7ksh0000gn/T/276EEDC9-A774-408C-B14E-9C04124D377C/5100D986-E078-4BD8-A894-9163DD594967.xcactivitylog [job_id: 5995640B-3785-48A5-B4BD-08593C61822A]
[ INFO ] [ProcessMetricsJob] finished processing file:///var/folders/rm/0tz8w5hx4kb597326bxp7ksh0000gn/T/276EEDC9-A774-408C-B14E-9C04124D377C/5100D986-E078-4BD8-A894-9163DD594967.xcactivitylog [job_id: 5995640B-3785-48A5-B4BD-08593C61822A]```

I try to use Grafana to create metrics that will view data sources in Postgres directly. so I need to know the data, the schemas, and their tables, data relationship in each table. Are there any documents about them? I can guess most of the tables, columns, but it will be easy if we have documentation about them.

Hey guys, so I have been working now with XCMetrics for quite so long and it shows lots of great data that we need, the problem now that we are mapping the data into grafana board to monitor our build times. The problem now is that the postgres database whenever more data is there, the slowest the query to map data is.

especially build_steps and build_targets tables, they are super slow even opening the table and sorting by day asc

I am not sure if there is some problem to that? other than for example deleting old data?

Thank you

XCLogParser & XCMetrics is cool idea, the demo shows the graph is pretty. Is there any plan to integrate the web interface to the XCMetric service? 🚀🚀🚀

Hello, Im trying to use docker-compose-local.yml and my postgres database is growing Is there any build in solution to delete old data? Or I can just drop old partitions?

Hi! I'm trying XCMetrics to see how we can leverage it within our organization. One thing that it is not clear to me is whether the web interface that is shown in the presentation video is included in the project.

I've read the documentation and deployed locally the server, but it looks like there is only the part of the backend that gather metrics. Is that correct?

Thanks a lot

Hi there As far as i know xcmetrics will copied xcactivitylog from derived data to ~/Library/Caches/XCMetrics, So I think, the longer this folder will contain a lot of .xcactivitylogs and will require a lot of storage space on the hard disk, Can xcmetrics delete xcactivitylog automatically? perhaps Instead of renaming the file with UPLOADED.xcactivitylog can we just delete it?

Hi all,

Thank you for this awesome project ❤️

We are investigating it and we want to integrate it in order to measure our build times.

I wander do you have any plugins for measuring unit test timing (I'm talking about each test execution time)? Do you consider viable option to add a plugin for measuring unit test timing or you think it's not related to this project ?

Hey folks,

It looks like we have version 0.0.11 as release on this repo but that release is not reflected as an image tag on dockerhub. Would it be possible to tag the latest dockerhub image with v0.0.11?

Thanks!

I was deploying XCMetrics to AWS and wanted to use Aurora PostgreSQL Serverless, however the only version available is 10.14 which, I realised after the fact, is not supported by XCMetrics. The only place in the docs where PSQL's version is mentioned is in Kubernetes configs. I think it would be better if the version was explicitly stated in the How to Deploy Backend.md file. Though I am actually not sure if version 11 would suffice.

Second commit, which I can push as a separate PR, just fixes a misspelling of a variable in a log message

I encountered issue when deploying using docker-compoese, following the documentation provided.

command: ["./XCMetricsBackend",
                  "queues",
                  "--scheduled",
                  "--env",
                  "production"]

Turns out that the command does not take exec path. In my case I should change to

command: [ "queues",
                  "--scheduled",
                  "--env",
                  "production"]

After change it, in my xcmetrics service, it will stuck when booting and only produce this log

[ NOTICE ] Connecting to xcmetrics in postgresql as xcmetrics password length 15

[ INFO ] Using redis host redis and port 6379

[ INFO ] Starting scheduled jobs worker

I cannot connect to localhost:8080 using browser, even after 10 minutes waiting for the service to boot up.

Is there any change this is because the service boot command is overridden and the service in port 8080 is not started yet? When I see docker documentation, command property is used to override default command which in XCMetrics Dockerfile is

# Start the Vapor service when the image is run, default to listening on 8080 in production environment
ENTRYPOINT ["./XCMetricsBackend"]
CMD ["serve", "--auto-migrate", "--env", "production", "--hostname", "0.0.0.0", "--port", "8080"]

We encountered an issue trying to deploy the latest XCMetrics backend docker image via Google Could Run and are unable to resolve it.

Environment:

• PostgreSQL: v12
• docker image latest

Env variables are set to

• XCMETRICS_USE_ASYNC_LOG_PROCESSING="0"
• XCMETRICS_USE_CLOUDSQL_SOCKET="1"
• XCMETRICS_CLOUDSQL_CONNECTION_NAME="***"
• DB_NAME="database name"
• DB_USER="database user"
• DB_PASSWORD="***"

Google Could Run docker image start failed

{
"textPayload": "Fatal error: No Queues driver configured. Configure with app.queues.use(...): file Queues/Application+Queues.swift, line 67",
"insertId": "***",
"resource": {
"type": "cloud_run_revision",
"labels": {
"revision_name": "xcmetrics-00004-soz",
"project_id": "***",
"configuration_name": "xcmetrics",
"location": "europe-west1",
"service_name": "xcmetrics"
}
},
"timestamp": "2022-01-27T09:53:07.063545Z",
"labels": {
"instanceId": "***"
},
"logName": "***/logs/run.googleapis.com%2Fstderr",
"receiveTimestamp": "2022-01-27T09:53:07.067705330Z"
}

Any idea what we could be doing wrong?