Dear support team,
We are considering to buy Gitlab Enterprise so I am running a POC on Gitlab
CE 7.13.3. We have a few test customers who recently reported they ran out
of free space under /var volume so I added a new 300GB volume under
/apps/data and I started to migrate the existing Git data. I did follow the
following
guide:
https://gitlab.com/gitlab-org/omnibus-gitlab/blob/master/doc/settings/configuration.md#storing-git-data-in-an-alternative-directory
Everything went fine until gitlab-ctl reconfigure, when the following
happened:
Recipe: gitlab::gitlab-rails
* execute[clear the gitlab-rails cache] action run
================================================================================
Error executing action `run` on resource 'execute[clear the
gitlab-rails cache]'
================================================================================
Mixlib::ShellOut::ShellCommandFailed
------------------------------------
Expected process to exit with [0], but received '1'
---- Begin output of /opt/gitlab/bin/gitlab-rake cache:clear ----
STDOUT:
STDERR: rake aborted!
Errno::ENOENT: No such file or directory - connect(2) for
/var/opt/gitlab/redis/redis.socket
/opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/redis-3.1.0/lib/redis/connection/ruby.rb:180:in
`connect_nonblock'
/opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/redis-3.1.0/lib/redis/connection/ruby.rb:180:in
`connect'
/opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/redis-3.1.0/lib/redis/connection/ruby.rb:209:in
`connect'
/opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/redis-3.1.0/lib/redis/client.rb:304:in
`establish_connection'
/opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/redis-3.1.0/lib/redis/client.rb:85:in
`block in connect'
/opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/redis-3.1.0/lib/redis/client.rb:266:in
`with_reconnect'
/opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/redis-3.1.0/lib/redis/client.rb:84:in
`connect'
/opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/redis-3.1.0/lib/redis/client.rb:326:in
`ensure_connected'
/opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/redis-3.1.0/lib/redis/client.rb:197:in
`block in process'
/opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/redis-3.1.0/lib/redis/client.rb:279:in
`logging'
/opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/redis-3.1.0/lib/redis/client.rb:196:in
`process'
/opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/redis-3.1.0/lib/redis/client.rb:102:in
`call'
/opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/redis-3.1.0/lib/redis.rb:436:in
`block in keys'
/opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/redis-3.1.0/lib/redis.rb:37:in
`block in synchronize'
/opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/redis-3.1.0/lib/redis.rb:37:in
`synchronize'
/opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/redis-3.1.0/lib/redis.rb:435:in
`keys'
/opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/redis-store-1.1.4/lib/redis/store/namespace.rb:29:in
`block in keys'
/opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/redis-store-1.1.4/lib/redis/store/namespace.rb:50:in
`namespace'
/opt/gitlab/embedded/service/gem/ruby/2.1.0/gems/redis-store-1.1.4/lib/redis/store/namespace.rb:29:in
`keys'
/opt/gitlab/embedded/service/gitlab-rails/lib/tasks/cache.rake:7:in
`block (2 levels) in <top (required)>'
Tasks: TOP => cache:clear
(See full trace by running task with --trace)
---- End output of /opt/gitlab/bin/gitlab-rake cache:clear ----
Ran /opt/gitlab/bin/gitlab-rake cache:clear returned 1
Resource Declaration:
---------------------
# In
/opt/gitlab/embedded/cookbooks/cache/cookbooks/gitlab/recipes/gitlab-rails.rb
232: execute "clear the gitlab-rails cache" do
233: command "/opt/gitlab/bin/gitlab-rake cache:clear"
234: action :nothing
235: end
236:
Compiled Resource:
------------------
# Declared in
/opt/gitlab/embedded/cookbooks/cache/cookbooks/gitlab/recipes/gitlab-rails.rb:232:in
`from_file'
execute("clear the gitlab-rails cache") do
action :nothing
retries 0
retry_delay 2
default_guard_interpreter :execute
command "/opt/gitlab/bin/gitlab-rake cache:clear"
backup 5
returns 0
declared_type :execute
cookbook_name "gitlab"
recipe_name "gitlab-rails"
end
Running handlers:
[2015-10-26T11:31:33-04:00] ERROR: Running exception handlers
Running handlers complete
[2015-10-26T11:31:33-04:00] ERROR: Exception handlers complete
Chef Client failed. 5 resources updated in 67.44986763 seconds
[2015-10-26T11:31:33-04:00] FATAL: Stacktrace dumped to
/opt/gitlab/embedded/cookbooks/cache/chef-stacktrace.out
[2015-10-26T11:31:33-04:00] ERROR: Found 1 errors, they are stored in the
backtrace
[2015-10-26T11:31:34-04:00] FATAL: Chef::Exceptions::ChildConvergeError:
Chef run process exited unsuccessfully (exit code 1)
I did try to rerun gitlab-ctl reconfigure, and for second time it went
through successfully. I finished the guide and started up my gitlab
service, but all my existing projects looks empty, the project is there,
the path looks correct but the size is reported as 0 and last commit shows
never:
Project info:
- Name: *store <http://gitmas01.isus.emc.com/root/store>*
- Namespace: *Administrator
<http://gitmas01.isus.emc.com/admin/users/root>*
- Owned by: *Administrator
<http://gitmas01.isus.emc.com/admin/users/root>*
- Created by: *Administrator*
- Created on: *September 14, 2015*
- http: *http://gitmas01.isus.emc.com/root/store.git
<http://gitmas01.isus.emc.com/root/store>*
- ssh: *[email protected]:root/store.git
<http://gitmas01.isus.emc.com/root/store>*
- fs: */apps/appadmin/gitlab/git-data/repositories/root/store.git*
- Size *0.0 MB*
- last commit: *Never*
- access: * Private*
I double checked everything, and path/permissions look good:
[root@gitmas01 gitlab]# cat /etc/gitlab/gitlab.rb | grep git_data
git_data_dir "/apps/appadmin/gitlab/git-data"
[root@gitmas01 gitlab]# cat /var/opt/gitlab/gitlab-shell/config.yml | grep
repos
repos_path: "/apps/appadmin/gitlab/git-data/repositories"
[root@gitmas01 gitlab]# ll /apps/appadmin/gitlab/
total 4
drwx------ 4 git root 4096 Oct 26 11:40 git-data
[root@gitmas01 gitlab]# ll /apps/appadmin/gitlab/git-data
total 8
drwxr-x--- 2 git git 4096 Oct 26 11:40 gitlab-satellites
drwxrws--- 27 git git 4096 Oct 9 14:22 repositories
[root@gitmas01 gitlab]# ll /apps/appadmin/gitlab/git-data/repositories
total 100
drwxrwx--- 2 git git 4096 Sep 14 05:32 accbharr
drwxrwx--- 2 git git 4096 Sep 14 05:32 accgowdv
drwxrwx--- 2 git git 4096 Oct 9 14:01 aggraa
drwxrwx--- 2 git git 4096 Sep 14 05:28 aldrim
drwxrwx--- 2 git git 4096 Sep 14 05:25 bogah
drwxrwx--- 4 git git 4096 Sep 24 03:52 Cheasty
drwxrwx--- 2 git git 4096 Sep 14 05:29 chengz5
drwxrwx--- 2 git git 4096 Sep 14 05:26 cheris
drwxrwx--- 2 git git 4096 Sep 14 05:24 clayta1
drwxrwx--- 2 git git 4096 Sep 14 05:27 dabasv
drwxrwx--- 2 git git 4096 Sep 14 05:31 dalkea
drwxrwx--- 2 git git 4096 Sep 14 05:31 georgg2
drwxrwx--- 2 git git 4096 Sep 14 05:29 GurumM
drwxrwx--- 2 git git 4096 Sep 14 05:26 guvvaa
drwxrwx--- 2 git git 4096 Sep 14 05:32 hegdep1
drwxrwx--- 2 git git 4096 Sep 14 05:30 henris1
drwxrwx--- 2 git git 4096 Sep 14 05:30 luskb
drwxrwx--- 2 git git 4096 Sep 14 05:30 meyerp1
drwxrwx--- 2 git git 4096 Sep 14 05:27 nagins1
drwxrwx--- 4 git git 4096 Oct 15 11:37 neeses
drwxrwx--- 2 git git 4096 Sep 14 05:24 pandid1
drwxrwx--- 2 git git 4096 Sep 14 05:27 patgupp
drwxrwx--- 2 git git 4096 Sep 14 05:31 ransia
drwxrwx--- 4 git git 4096 Sep 14 05:14 root
drwxrwx--- 2 git git 4096 Oct 9 14:22 Willey
[root@gitmas01 gitlab]#
I already tried to run gitlab-rake gitlab:check, but that neither helped.
Could you please advice?
Thank you!
Krisztian Fekete
Principal IT Architect
EMC Corporation
--
You received this message because you are subscribed to the Google Groups
"GitLab" group.
To unsubscribe from this group and stop receiving emails from it, send an email
to [email protected].
To view this discussion on the web visit
https://groups.google.com/d/msgid/gitlabhq/e89036fa-0d6a-4e2c-93c5-ac9a5114705c%40googlegroups.com.
For more options, visit https://groups.google.com/d/optout.
